Non-Interference Field-of-view Support Apparatus for a Panoramic Sensor

ABSTRACT

A support apparatus with adjustable mechanisms hold a spherical field-of-regard image and audio sensor assembly located at its distal end in front of a user&#39;s face such that the user&#39;s fine focus field-of-view of the foreground is not blocked by the mast or the sensor assembly. Automated mechanisms rotate and extend the armature and sensor assembly into position for face-to-face panoramic hands-free video teleconferencing, gaming, or logging. A portable wired or wireless host electronic device with a personal assistant application and sensor correlation system interactively communicates with support apparatus circuitry and servos, imagery, audio, eye and ROI tracking, neural, and user input and feedback systems to orchestrate responses to a local remote user. A sensor assembly includes a VLSIC multi-ROI processing system with integrated camera and display that hides the assembly and provides information to the user or onlooker.

CROSS-REFERENCE TO RELATED APPLICATIONS

This continuation application is related to and claims the benefit ofall pending U.S. Non-Provisional patent applications that specificallyincludes U.S. Ser. No. 11/354,779 filed Feb. 15, 2006 and published asUnited States Patent Publication No. 2007/0002131 entitled DynamicInteractive Region-of-Interest Panoramic/Three-Dimensional ImmersiveCommunications System and Method (abandoned); U.S. patent applicationSer. No. 11/830,637 filed Jul. 30, 2005, and published on Jan. 31, 2008as United States Patent Publication No. 2008/0024594 A1 entitledPanoramic Image-Based Virtual Reality/Telepresence Audio-Visual Systemand Method (abandoned); and U.S. patent application Ser. No. 12/266,308filed Nov. 6, 2007 and published as United States Patent Publication No.2010/0045773 A1 entitled Panoramic Adapter-System And Method withSpherical Field-of-View Coverage (abandoned). This continuation patentapplication also claims the benefit of application Ser. No. 13/294,986filed 11 Nov. 2011 entitled Non-Interference Filed-of-View SupportApparatus for a Panoramic Facial Sensor; and application Ser. No.13/507,190 filed on 11 Jun. 2012 and Continuation application Ser. No.14/788,437 filed 30 Jun. 2015 entitled Mobile User Borne Brain ActivityData and Surrounding Environment Data Correlation System. The aboveapplications are hereby incorporated by reference in their entiretiesinto the present application.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a personal mobile hands free apparatusfor holding a spherical field-of-view sensor assembly in place forsimultaneous face-to-face and panoramic video teleconferencing and datalogging such that the user's fine focus field-of-view of the foregroundis not blocked by the facial sensor.

2. Description of the Prior Art

Devices for face-to-face video capture have not been designed to hold asensor apparatus directly in front of the face of the user withoutobstructing the user's fine focus field-of-view. Or from keeping theapparatus from obstructing the fine focus field-of-view of a person infront of the user who is looking at the users face. Support apparatusthat are related to the present invention but that are patentlydifferent from the present invention include: U.S. Pat. No. 5,815,126,by Fan et al., issued 29 Sep. 1998, entitled “Monocular PortableCommunication and Display System”. A limitation of Fan is that Fan'scamera only looks outward from the users head mounted support and doesnot facilitate face-to-face video teleconferencing. In Fan thecontrolling host electronic device controls servos that move an armatureand display into the fine focus FOV of the user so the user can see thedisplay. In contrast, in the present invention the controlling hostdevice and the support mechanisms move a panoramic camera at the end ofthe armature out of the fine focus FOV of the eyes so the user can seethe scene in front of him or her. Furthermore, U.S. Patent 2005/0083248,by Biocca, Frank and Rolland, Jannick et al., dated 21 Apr. 2005,entitled “Mobile face capture and image processing system and method”disclose a camera with mirror system that only looks inward from thesides of the users face to capture a user's face and not outward suchthat a continuous panoramic view of the remaining surrounding scene canbe recorded and interacted with as provided for in the presentinvention. Another limitation of Biocca is that the head mounted supportarmature that holds a mirror or a camera blocks the peripheral FOV ofthe user who is wearing the support device. The purpose and design ofFan and Biocca's invention are distinctly different than the presentinvention.

Other related patents and patent applications that are distinguishablefrom the present invention include: U.S. Pat. No. 5,023,725, byMcCutchen, dated Jun. 11, 1991, entitled “Method and Apparatus forDodecahedral Imaging System” presents a handheld spherical FOV imagingsystem and an associated display system. A limitation of McCutchen isthat the hemispherical FOV system is not wireless and is handheld. U.S.Pat. No. 5,130,794 by Kurtis Ritchey, issued 14 Jul. 1992, entitled“Panoramic Image Based Virtual Reality Display System”; U.S. Pat. No.5,495,576 also by Kurtis Ritchey, issued 27 Feb. 1996, entitled“Panoramic Image Based Virtual Reality/Telepresence Audio-visual Systemand Method”. A limitation of Ritchey is that the sensor assembly is overthe user so it does not allow face panoramic teleconferencing; U.S. Pat.No. 5,844,824, by Newman et al., issued 1 Dec. 1998, entitledHands-free, Portable Computer and System; U.S. Pat. No. 5,886,735 byEdward Bullister, issued 23 Mar. 1999, entitled “Video TelephoneHeadset”; U.S. Patent 2005/0128286 A1 by Angus Richards, issued 16 Jun.2005, entitled “VTV System”. Richards's presents a head mounted supportwith a plurality of cameras that only look outward thus negating theability of the to capture the face of the user wearing his HMD.Additionally, U.S. Patent Application Publication 2010/0245585 A1, byFisher et. al., dated 30 Sep. 2010, entitled “Headset-basedTelecommunications Platform”; U.S. Pat. No. 7,861,985 B2 by NicoletteGalvin, issued 4 Jan. 2011, entitled “Hands-free Device Holder forSecuring Hand-held Portable Electronic Device with a Screen”; U.S.Patent Application Publication 2011/0085135 A1 by Eugene Bertolli, dated14 Apr. 2011, entitled “Free Space Hands Free Ocular Observation CameraMount”.

SUMMARY OF THE INVENTION

a. General Idea of the Claimed Invention

The present invention is directed at providing a personal mobilehands-free support apparatus with an adjustable armature and extensionmechanism that positions and holds a spherical field-of-view image andaudio sensor assembly located at its distal end in front of a user'sface such that the user's fine focus field-of-view of the foreground isnot blocked by the mast or the sensor assembly is provided. Manual orautomated mechanisms rotate and extend the armature with assembly intoposition for mobile face-to-face panoramic hands-free videoteleconferencing or logging. The portable host electronic device, suchas a personal digital assistant or cell phone, communicates with theapparatus circuitry, servos, spherical image sensor, audio system, eyeand head tracking, and other optional sensor systems to interactivelyand in an automated manner command and control the apparatus to hide andreduce the visual presence of the sensor assembly in front of the usersface for the user and to onlookers in front of the user. Optionally, inseveral embodiments of the invention a display is mounted on thearmature and sensor assembly to hide and conceal the sensor assembly andarmature and to provide audio-visual information to the wearer of theapparatus.

b. Objective of the Invention

There is a continuing need to capture a frontal view of the users facewhile the user is on the move so that the user can conduct mobile videoteleconferences. There is also a need for the audience at the far end ofthe teleconference to see what the user is looking at or lookindependently at the environment the user is occupying. There is also aneed to provide a device that allows portable hands-free interactionwith a portable digital device, like a PDA or cell phone. There is alsoa need to record the user's facial reaction to events whilesimultaneously recording events taking place in the environment the useris occupying. There is also a need for a support device with a portablefacial sensor that is responsive to automated wake up features of aportable device. There is also a need for a support device with a facialsensor located directly in front of the face of user that automaticallypositions itself to in response to the field-of-view and focus of theeyes of the user. There is also a need for a device that masks thedevice in front of the users face from the user and onlookers. There isalso a need to provide a support device that does not block theperipheral view of the user wearing the support device. There is also aneed to provide a support device that has a video sensor that has enoughstand-off distance such that the device captures the entire face of theuser. There is also a need for a support device that automaticallyaccommodates a video display device at a stand-off distance thatpositions itself in response to the field-of-view and focus of the useras defined by sensors, like an eye tracking system, that are worn by theuser. There is also a need for a portable hands-free support device thatfacilitates interaction with a wearable sensor assembly withaudio-visual capture capabilities and an integrated display such thatthe camera and display are concealed. There is also a need to provide asupport device simultaneously responsive to the both the users neural,sub-vocal, visual, and audio sensors and signatures and the surroundingenvironment audio-visual sensors and signatures integrated with thesupport device. There is also a need for a support device thatfacilitates presentation to the user that preserves the apparentdistances and the relationship between the accommodation and convergenceof content presented to the user. There is also a need to provide aVLSIC panoramic senor for a portable hands free support device withreduced volume for two-way telepresence. There is also a need to providea hands-free support device with body sensors and panoramicenvironmental sensors that integrate with a portable electronic devicewith processing capabilities that filter and converge sensor signaturesof the supported sensors and peripheral devices. There is a need toprovide a support device that is integrated with devices that are partof and connected to a telecommunications system and network. There is aneed to connect this system to a cloud computing system that is part ofa local area network (LAN) or wide area network (WAN) in order to logthis information for educational, entertainment, security, health care,and other applications in which the reaction of the user to thesurrounding environment needs to be monitored or documented. And thereis also a need to provide a device that is integrated with variousperipheral devices such as mobile electronic device such as a personaldigital assistant or cellular telephone, a voice recognition system,facial analysis system, sub-vocal recognition system, or brain activitysensor. It is an objective of the present invention to address theseabove needs.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a front perspective view of a non-interference field-of-viewsupport device for facial sensor that comprises a first embodiment ofthe present invention.

FIG. 2 is a front perspective view of the first embodiment of thepresent invention in which the support device is mounted to eyeglasses.

FIG. 3 is an enlarged top sectional view of the armature support housingof the first embodiment of the invention.

FIG. 4 is a perspective view an embodiment of the invention in which aneye tracking system is integrated into the invention to automaticallyraise and lower the support armature and sensor assembly in response tothe field-of-view of the user.

FIG. 5 is a perspective view of a second embodiment of the inventionwhich incorporates a semi-rigid bendable gooseneck armature.

FIG. 6a is a front perspective view of a third embodiment in which thearmature and sensor assembly are covered with a LED display coveringthat conceals the armature and sensor assembly to the user and adjacentpersonnel.

FIG. 6b is a front perspective view of the third embodiment of theinvention in which the armature and sensor assembly are in a solvedposition.

FIG. 7 is a side sectional view of the mechanism used to extend andretract the sensor assembly and armature.

FIG. 8a is an enlarged sectional view of a gooseneck armature with anattached rubber track.

FIG. 8b is a further enlarged sectional view of a gooseneck armaturewith an attached rubber track like the one shown in FIG. 10.

FIG. 8c is an enlarged sectional view of the armature comprising a cablewithin which a plurality of insulated wire conductors carrycommunication signals to and from the spherical sensor.

FIG. 8d is an enlarged sectional view of the armature comprising a solidcore semi-flexible wire wrapped in insulation, then conducting wiresthat run to and from the sensor, and then an insulated covering.

FIG. 9a is a perspective drawing of the exterior of the spherical sensorwith a plurality of objective lenses and microphones of the presentinvention.

FIG. 9b is a side sectional drawing showing the interior of thespherical sensor attached to the support armature of the presentinvention.

FIG. 10a is the sensor with male plugs that plugs into either thearmature or the recharging assembly.

FIG. 10b is the armature with female sockets that accepts the sensor inFIG. 10 a.

FIG. 10c is a recharging assembly with female sockets that accept thesensor in FIG. 10 a.

FIG. 11a is an exterior perspective of a portion of the armature with aLED display with images displayed.

FIG. 11b is an exterior perspective of a portion of the armature with aLED display with text displayed.

FIG. 12a is a diagrammatic side sectional drawing of a VLSIC sphericalsensor assembly with imaging and display capabilities for use in thepresent invention.

FIG. 12b is an exterior perspective of a VLSIC spherical sensor assemblyshown in FIG. 12a for use in the present invention.

FIG. 12c is enlarged side sectional drawing of a portion of the VLSICspherical sensor described in FIG. 12a . Sensor also including imagingand display capabilities according to the present invention.

FIG. 13a is a diagrammatic perspective view of another embodiment of anintegrated micro-bead camera and display used on the sensor assemblyaccording to the present invention showing the image capture phase ofoperation of the VLSIC device.

FIG. 13b is a diagrammatic perspective view of the embodiment shown inFIG. 13a which includes an integrated micro-bead camera and display usedon the sensor assembly according to the present invention showing thedisplay phase of operation of the VLSIC device.

FIG. 14a is a side sectional view of yet another embodiment of anintegrated camera and display used on the sensor assembly according tothe present invention showing the image capture phase of the system.

FIG. 14a is a side sectional view of the embodiment shown in FIG. 14awhich includes an integrated camera and display used on the sensorassembly according to the present invention showing the image displayphase of the system.

FIG. 15 is a diagrammatic plan view of the invention mounted toaugmented reality eyeglasses and a computer and illustrating thepanoramic view of the sensor.

FIG. 16 is a plan view of the invention mounted to a user's headillustrating the field of coverage of the panoramic sensor to the usersface when in lowered to the forward position.

FIG. 17a-c is a perspective view of the eye-tracking embodiment of theinvention.

FIG. 18a is a side view diagram illustrating the field of view and thearmature and sensor positions available to the user operating thepresent invention.

FIG. 18b is a plan view diagram illustrating the field of view and therotation of the armature and sensor at positions available to the useroperating the present invention.

FIG. 19 is a screen shot of the user display screen on a host digitalcommunication device (i.e. an iPhone) acted upon by the user to controlthe armature and spherical sensor and content thereof according to thepresent invention.

FIG. 20 is a block diagram of the interaction of the components of thepresent invention that interactively raise/lower, extend/retract anarmature and sensor for mobile face-to-face panoramic videoteleconferencing or data logging.

FIG. 21 is a block diagram of the interaction of the components of thepresent invention that provide an unobstructed view to the useroperating the present invention for panoramic mobile face-to-facepanoramic video teleconferencing or data logging.

FIG. 22 is a block diagram of the interaction of the components of anembodiment of the present invention that provide command and control ofthe present invention.

FIG. 23a is diagrammatic perspective illustrates insertion of a portionof the foreground imagery captured by the panoramic sensor between theuser and the sensor and armature to facilitate an uninterrupted view bythe user of the foreground scene.

FIG. 23b 1-3 is a diagrammatic perspective that graphically illustratesthe basic steps in image processing and display that occurs to prepare aportion of the panoramic scene to be overlaid to hide the sensor fromthe users FOV.

FIG. 24a is photo of the image recorded by two back to back lenses ofthe panoramic camera in FIG. 1 showing barrel distortion and obstructionof the users FOV and the onlooker by the support armature of the presentinvention.

FIG. 24b is photo of the image recorded by two back to back lenses ofthe panoramic camera with the barrel distortion removed, oriented, andplaced side by side one another; and additionally masking of thearmature and sensor in the processed image presented to a remote usertaking part in a 2-way face to face panoramic video phone call.

FIG. 25 is a diagrammatic representation of a two-way teleconferenceenabled by users of the present invention.

FIG. 26 is a perspective illustration of an embodiment in which thepresent invention is connected by cable to a host electronic device.

FIG. 27 is a perspective illustration of a basic wireless connectionbetween the invention and a host electronic device.

FIG. 28a is a perspective illustrating the components of a more robustwireless system comprising a portable electronic device, sphericalsensor support, neural sensors, voice recognition sensors, and imagesensors used for face-to-face panoramic video teleconferencing accordingto the present invention.

FIG. 28b is an exterior view of the user shown in FIG. 28a wearing ascull cap (disguised as a wig) with neural sensing capabilities tointeractively operate/drive armature and spherical sensor worn by theuser for face-to-face panoramic video teleconferencing.

FIG. 29a is a perspective illustration of an alternative embodiment thatincorporated fiber optic image conduits to deliver a panoramic imagefrom a sensor assembly to the camera of a portable wireless device forface-to-face panoramic video teleconferencing according to the presentinvention.

FIG. 29b is a side sectional view of a sensor assembly with a smalldisplay screen shown in FIG. 29 a.

FIG. 29c is a side sectional view of an adapter for receiving andfocusing an image onto the image sensor of the portable electronicdevice, like an iPhone, shown in FIG. 29 a.

FIG. 29d is a side sectional view of an alternative embodiment of theadapter assembly shown in FIG. 29a in which at least one CMOS imagesensor in the sensor assembly transmits and image signal over a cable tothe adapter with at least one display for projection onto the camerasensor of the portable electronic device.

FIG. 30a-d are perspective illustrations of various applications of theinvention.

FIG. 30a illustrates an embodiment in which the invention is integratedinto an electronic communication device entirely worn on the users head.

FIG. 30b illustrates an embodiment of the invention in which the sensorsupport is integrated into a hat.

FIG. 30c illustrates an embodiment of the invention in where thearmature with panoramic sensor assembly flips up from the belt of auser.

FIG. 30d illustrates an embodiment of the invention in which the sensoris unplugged from the mast and used remotely.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a perspective view of a first support apparatus 1 for holdinga spherical field-of-coverage image and audio sensor assembly 2 in placeaccording to the present invention. The sensor assembly is held securelyin place on the distal end of a support armature 3. Typically the sensorassembly is located at the distal end of the supported armature. Butoptionally the sensor assembly may be integrated to be all along thearmature. The armature consists of a group of insulated metal conductivewires that send and receive data to and from the sensor assembly to ahost electronic device 44 such as a personal digital assistant (PDA)with wireless video cellular telephone functionality. A personal digitalassistant, also known as a palmtop computer, or personal data assistant,is a mobile device that functions as a personal information manager.Current PDAs often have the ability to connect to the Internet. A PDAhas an electronic visual display, enabling it to include a web browser,but some newer models also have audio capabilities, enabling them to beused as mobile phones or portable media players. Many PDAs can accessthe Internet, intranets or extranets via Wi-Fi or Wireless Wide AreaNetworks. Many PDAs employ touchscreen technology. The sensor assemblyhousing is 14 millimeter in diameter and spherically shaped. The housingholds all components of the sensor assembly 2 in place. The armature isconstructed of a four millimeter diameter rigid wire 21 made of metalthat is 25 centimeters in length. The wire 21 is insulated by insulatingmaterial 23 from conducting data communication wires 9. The armature iscurved at the distal end with a bend radius of ninety degrees for every12 centimeters. This places the sensor assembly forward of the face ofthe user. The proximal end of the armature is held into place by a clamplocated in an armature support housing 4. The support housing includes aswivel assembly 5 comprising a hinge and socket that connects to anadjacent support structure 6. The swivel is tensioned by a lock nut andwashers such that when the housing 4 is manually rotated into positionfor hands-free use by a user the housing stops in a position desired bythe user of the device apparatus 1.

The adjacent support structure 6 includes a fastener that is mounted toa head worn support 7, such as the eyeglass frames shown in FIG. 2.Wiring running from the assembly 2, through the armature 3, and into thehousing 4 continues onward through a flexible cable 8 that runs to ahost electronic device. FIG. 3 shows and interior section 3-3 of thehousing in FIG. 4. As shown in sectional view of FIG. 3 the bundledinsulated conductive wires 9 that comprise the semi-flexible armature 3are broken out and joined by connecting pins of a connector jack 10 tocorresponding wires that comprise a flexible cable 8 that exits thehousing 4. The cable 8 runs from the housing to a mini jack which plugsinto a host electronic device 44 with face-to-face panoramic videoteleconferencing capability. A second connector 11 is included in thesupport housing 4 to accept electrical signal input and output to an eyetracking sensor 12 shown in FIG. 4. Data from the eye tracking sensor 12is transmitted through a eye tracking cable 13, connector 11, housing 4,connector 10, and through cable 8 to a host electronic device 44.Finally, it should be noted that tracking sensor 12 and sensor assembly2 may incorporate infrared or visible sensors to assist in tracking thepupils of the eyes of the user.

FIG. 5 is a perspective view of a second embodiment of the supportdevice apparatus 1 for holding a spherical field-of-coverage image andaudio sensor assembly 2 in place according to the present invention. Thearmature comprises a flexible gooseneck material well known to those inthe lighting and borescope industry. Wiring running from the sensor 2,through the hollow stem of the gooseneck armature 3, and into thesupport housing 4 continues onward through a flexible cable 8 that runsto a host electronic device. The support housing 4 includes a mechanismthat raises and lowers the armature 3 and sensor assembly 2. DesignationA1 indicate the rotational direction of the motorized hinge. DesignationA2 indicates the direction of the armature extension. The range of theextension will typically vary between 15.24 centimeters to 30.48centimeters to accommodate the eyes of the user at a comfortable infocus reading distance. Those skilled in the art will realize there arenumerous types of miniature actuators and small electric motorizedservos in the industry that may be incorporated into the presentinvention. And additionally, that the motors may even beradio-controlled by a cellular phone. Additionally, different types ofmotorized gooseneck, rigid rod, hollow tube, or telescoping extensionsbe used in the present invention without departing from the spirit ofthe invention.

In addition to the functionality shown in FIG. 5, FIG. 6a-6b areperspective views of a third embodiment of the support device apparatus1 in which the support housing 4 includes a mechanism that extends andretracts the armature 3 and sensor 2 forward and backwards as indicatedby the arrows A2. Arrows A2 indicate the extension and retractiondirection of the armature and sensor. FIG. 6a shows the armature in theextended position. FIG. 6b shows the armature in the retracted position.In the retracted position the proximal end of the armature 3 is stowedin a protective extension tube 14 that is constructed into andintegrated with the armature support housing 4. The tube may beconfigured to wrap around the back of the head of the user in order toassist in holding the support device apparatus 1. The proximal end ofthe armature extends into the housing and may extend out of the backside of the housing when the armature is retraced. The proximal end ofthe armature is held tight when extended by a tensioned springs in thehousing that push against the armature that penetrates into the housing.The armature has a rear hinge that keeps the proximal end of thearmature from being pulled out of the housing. The cable has slack toallow it to be extended. Alternatively, the cable is on a spindle thatreels the cable up when retracted and reels out when extended.

FIG. 7 is a side sectional view 7-7 of FIG. 6a-6b of the mechanisms inthe armature support housing 4 used to extend and retract the armature3. In this embodiment the armature support housing 4 is a hollowrectangular shaped housing which includes a first servo S1 for raisingand lowering the armature. A shaft 17 of the servo runs from thearmature support housing 4 through a socket to the adjacent supportstructure 6. Support structure 6 is attached to the eyeglasses frame 7in an anchored manner. When the servo is commanded electronically thetorque raises or lowers the armature support housing 4 by a commandedinterval. The interval is determined by how long the current is applied.The direction of the servo rotation is determined by direction of thecurrent applied to the reversible motor servo. Similarly, a second servoS2 is operated bi-directionally to extend and retract the armature. Thesecond servo turns a set of shafts and gears that move the armature. Onone side of the armature a flexible rubber indented track 15 isattached. The indented track engages a gear G1 which moves the indentedtrack with the attached armature 3 forward and backward by a commandedinterval. Once again the interval is determined by how long the currentis applied. And once again the direction of the servo S2 rotation isdetermined by direction of the electrical current applied to thereversible motor servo. A miniature stepper, brushless, pancake DC orPWM motors may be used in the present invention because they may bebattery controlled, are compact, and are responsive to precision controlapplications. A miniature series-wound motor referred to as a universalmotor designed to operate on either AC or DC power may be incorporated.The armature is held in place on the track 15 by a plurality of springtensioned rubber wheels 16 that apply pressure to the sides of thearmature 3 by equal amounts at intervals facing inward to the armatureinternally throughout the armature support housing 4. Optionally, therubber wheels apply pressure to the sides of a display 19, here anelectronic paper LED or OLED display is incorporated that covers atleast some portion of the armature 3. A flexible color display of a typethat may be incorporated into the display of the present invention ismanufactured by Philips Research Laboratories, Endhoven, TheNetherlands, disclosed at the Society for Information Display Symposium,Session 16: Flexible Displays, May 25-27, 2004, Seattle, Wash., USA byP. Slikkerveer. Referred to as “e-paper” displays they may be rolled andfolded slightly, are three times the thickness of paper, are lightweight, and can be manufactured so that the image can cause the displayto be opaque or allow a see through capability. Electrical power,command and control signals to drive the display 19 are introduced byelectrical contacts 20 located along the sides of the track in thepresent embodiment of the invention. Electrical wires and circuitry areprovided to connect and power electrical components located in thearmature support housing. Electrical power and control signals to theservos S1 and S2 are provided by host electronic device. Alternatively,a battery and electronics to drive servos may be included in themechanized armature support housing 4. An ear pad 18 is attached to theadjacent support structure 6. The ear pad 18 cushions the head of theuser should the users head come in contact with structure 6.

FIG. 8a-d are enlarged sectional embodiments of various armature 3designs that may be used to realize various embodiments of the presentinvention that correspond to the same direction as FIG. 6a-6b cutline7-7. FIG. 8a is an enlarged sectional view of a gooseneck armature 3with an attached rubber track like that described in FIG. 7. FIG. 8b isa further enlarged sectional view of a gooseneck armature with anattached rubber track like the one shown in FIG. 7. FIG. 8c is anenlarged sectional view of the armature comprising a cable within whicha plurality of insulated conductor wires 8 carry signals to and from thespherical sensor. FIG. 8d is an enlarged sectional view of the armaturecomprising a solid core semi-flexible wire wrapped in insulation, thenconducting wires that run to and from the sensor, and then an insulatedcovering. Optionally, a flexible cable 8 may be run through the innertube of the gooseneck armature. The servo that extends and retracts thearmature may include a spindle in the housing to reel in and reel outthe cable. This actuation is done in synchronization with armatureextension and extraction. Also alternatively, the armature may be bentor shaped to come up at the lower side of the face of the user so thatthe armature does not significantly block the peripheral FOV of theuser.

FIG. 9a is a perspective drawing of the exterior of the spherical sensor2 with a plurality of objective lenses 24 and microphones 25 of thepresent invention. The objective lens systems comprise six equallyspaced fisheye lenses with a field-of-view (FOV) of 190 degrees facedoutward from the center point of the spherical shaped housing.Stereoscopic FOV coverage may be sampled from the imagery using computerprocessing for stereoscopic viewing. Alternatively, bioccular andmonoscopic imagery may be sampled out for viewing using lenses with agreater than 180 degree FOV or at least with lenses with greater than a180 degree FOV. Alternatively, a non-uniform fiber optic image conduitbundle arrangement known by the trade name “fibereye” to reduce orremove image distortion may be incorporated between objective lens andthe sensor array 26. FIG. 9b is a side sectional drawing showing theinterior of the spherical sensor attached to the support armature of thepresent invention. A curved light sensitive recording array 26 isincorporated into the present invention. The CMOS sensor incorporatedhas multiple Region of Interest (ROI) tracking and readout capability. Atype of ROI sensor compatible with an incorporated into the presentinvention is disclosed in co-pending US Patent Application Publication2007/002131 A1, by Ritchey, dated 4 Jan. 2007, entitled “DynamicInteractive Region-of-Interest Panoramic/Three-Dimensional ImmersiveCommunications System and Method”. It will be obvious to those skilledin the art that either CMOS, CCD, or light sensitive recording deviceswith a ROI sampling capability may be used in the present invention.Stereoscopic cameras that approximate human vision are preferablebecause they reflect how humans naturally see the world and providedepth clues to the brain. And panoramic stereoscopic cameras are evenmore preferable because they add a spatial awareness and allow thereplay of the total surrounding environment stimulating the userssenses, memories, and resulting thoughts. Portable head-mounted (HM)panoramic video cameras of a type that may be used in the presentinvention include U.S. Pat. No. 6,552,744 B2 by Chen, dated Apr. 22,2003, entitled Virtual Reality Camera which presents a camera whichrecords discrete still or video images that can be stitched together tocreate a panoramic scene that incorporates computer processing so thatthe user may pan and zoom around the panoramic scene. And U.S. PatentApplication 2001/00105555 and U.S. Pat. No. 6,539,547, by Driscoll,dated Aug. 2, 2001, discloses a Method and Apparatus for electronicallyrecording, storing, and distributing panoramic images from a panopticcamera system to a remote location using the internet. And U.S. PatentPublication 2005/0157166 by Peleg, dated Jul. 21, 2005 entitledDigitally Enhanced Depth Image which discloses a camera method tosimultaneously record, store, and process panoramic stereoscopicimagery. However, use of apparatus 1 and it's embodiments with the aboveprior art is unobvious, novel, and useful.

FIG. 10a is a perspective drawing illustrating an alternative sensorassembly 2 arrangement. A plurality of male posts 27 plug intoassociated female holes 28 of a socket 29 in either the armature 3 orthe recharging assembly 30. Alternatively the recharging assembly canoperate independently of the armature assembly when connected to anyhost digital device, such as a computer with panoramic videoteleconferencing software or firmware. FIG. 10b is the armature withfemale sockets that accepts the sensor in FIG. 10a . FIG. 10c is arecharging assembly with female sockets that accept the sensor in FIG.10a . Alternatively, the sensor assembly and armature are one in thesame shape. For Instance the sensor assembly and armature are anelongated round tube or rectangular box that extends from the supporthousing. In such an instance, the microphones and optics are placed oneach side of the elongated assemblage to provide a continuous panoramicFOV coverage that includes facial coverage of the user.

FIG. 11a is a side sectional drawing of a volumetric Very Large ScaleIntegrated Circuit (VLSIC) spherical sensor assembly 31 ideally suitedfor use in the present invention. Sensor assembly 31 is substituted forsensor assembly 2 in the present embodiment of the invention. Sensorassembly 31 includes on board panoramic image processing and displayfunctionality. The circuit includes region-of-interest processing,distortion removal means, and image stitching means, scaling, read outand in means, communications transmission means, electrical power means,and cooling means. The sensor is driven by a local or remote usersending x-y-z coordinate pan and zoom information to the sensor. Inoperation a user head mounted display assembly with position sensing andeye tracking outputs coordinate yaw, pitch, and roll, pan, and zoom datato the VLSIC that defines the scene to be sampled by the ROI portion ofthe VLSIC. The positional data defined is operated upon by the VLSIC todefine the ROI output for display to a user. The user will typically bea remotely located user of the system who wants to pan and zoom aroundthe panoramic scene of a user who is or was wearing device apparatus 1in another location as depicted in FIG. 25.

In FIG. 11a the VLSIC sensor 32 comprises an inner silicon chip materialon which and throughout which micro-circuitry that forms the VLSIC isimprinted. The VLSIC circuitry includes a field programmable gate arrayintegrated ROI image processing capabilities. The exterior of the VLSICis a continuous CCD or CMOS sensor whose light sensitive elements aredistributed across the outward surface of the VLSIC. Integrated andadjacent to the curved light sensitive surface of the VLSIC is thecurved inner concave shaped portion of the fisheye lens 33 such thatsubjects imaged by the fisheye are projected onto the light sensitivesurface of the VLSIC 32. Integrated over and adjacent the outer surfaceof the fisheye lens is an addressable transparent Organic Light-EmittingDiode (OLED) or Light-Emitting Diode (LED) display 34. Such LED and OLEDdisplays are typically used in head mounted displays in which graphicsare overlaid over the real world background observable through the LEDdisplay, but in this instance the display is use as a shutter duringimage capture operations of the device apparatus 1. The LED display isdesigned such that it may be operated as a shutter to block light thatentering the fisheye lens or alternatively to allow light to enter thefisheye lens. Additionally, the LED may be operated as a visual display.It is known to those skilled in the art that addressable LED, LCD, DLP,or SLM's may be used interchangeably in the present invention asshutters or a display in the present embodiment.

Optionally, as depicted in FIG. 11b the LED may be covered with amicro-bead lens 43 array to capture imagery of certain coverage. In suchan instance the lenticular micro-bead array 43 is positioned over theexterior surface of the LED 34. Images captured are transmitted throughlens array 43, through the LED 34, through the glass 119 of the fisheyelens 33, and then to the light sensitive surface 117 of the VLSIC 32.Lenticular beads may have a FOV that provides overlapping field of viewcoverage from multiple points of view about the sensor. The overlappingcoverage facilitates stereoscopic display of images played back fordisplay. Alternatively, narrow FOV lenticular beads may be incorporatedto render images with little or no distortion. The outer curved side 124of the fisheye lens is placed adjacent to the inner curved side of theLED. Preferably, the micro-lens micro-bead array fisheye lens, LEDarray, and outer surface of the VLSIC are welded or adhesively securedto one another to form a single composite assembly 3. The curved inneredge 118 of the fisheye lens is placed adjacent to the light sensitiverecording surface of the VLSIC. As shown in FIG. 16, playback of theforeground imagery captured by the micro-bead lenses on the oppositeside of the sensor 31 S. Patent Publication No 2003/0107894 to Dolgoffcited in U.S. Patent Application Publication 2008/0030573 A1 is adoptedby the present inventor and is incorporated for image capture anddisplay in a novel, useful, and unobvious manner in the presentinvention. Similarly, as shown in FIGS. 12a-b , imagery captured bysensor assembly 2, VLSIC assembly 3 of apparatus 1, or from a local orremote user of electronic device is displayable on the LED covering thearmature. The armature 3 may also be covered an image is used to maskthe sensor from blocking the foreground FOV of the user 22. Andlikewise, playback of the facial imagery of the user captured by themicro-bead lenses on the opposite side of the sensor 31 is used to maskthe sensor from blocking the users face 22 when viewed by an onlooker36. The use of micro-bead lens array 43 and the use of lenticular lensesfor auto-stereoscopic viewing as taught by the Guilk U.S. Pat. No.5,724,758, the Ossoinak U.S. Pat. No. 2,833,176, and the U. capture anddisplay LED system. Micro-bead lens array 43 with micro-beads tofacilitate masking and auto stereoscopic viewing. For example, images ofan onlooker 36, subject 37, and the user of the device 22 are displayedto a local and remote user on the LED 34 for the user to see duringimages. Imagery and text 45 is be presented to the user or an onlooker.Preferably the imagery is derived by hands free input devices such assensor 2, eye tracking 12, voice to text recognition, sub-vocal, andneural sensing systems integrated with device apparatus 1 and consistentwith the objectives of the present invention. Additionally, it hasbecome apparent from prototype work that at night time the LED 34 may beused to illuminate the users face or the surrounding area duringpanoramic video teleconferencing. This is especially advantageous whensensor assembly 2 is used for eye tracking and only the visible spectrumof light is used to monitor the eyes of the user.

VLSIC drive circuitry 120 transmits image signatures from the lightsensitive recording surface of the VLSIC CMOS sensor that is adjacent tothe curved interior glass surface of the fisheye lens. The LED displaycircuitry is connected to the core VLSIC processing circuitry. Thecontrol circuitry 121 for the LED is imprinted on the side of thefisheye lens that forms a seam 35 dividing Side A and Side B fisheyelenses. Alternatively, a fiber optic imaging arrangement may replace thefisheye lens arrangement. In such an instance tapered fiber optic imageconduits transmit images from their entrance end adjacent and integratedwith the display to the exit end of the fiber optic image conduitadjacent to and integrated with light sensitive elements of the VLSIC.The driving circuitry is connected to the core VLSIC processingcircuitry for the LED when fiber optic image conduits may be imprintedon the exterior cladding or coating between or at the edges of the fiberoptic fibers. The sensor also comprises an access port 38 for input andoutput of data and electrical power that comes via wiring 9 or fiberoptics. Non-uniform fiber optics (i.e. Fibereye™) or panomorphic lensesmay be integrated into the arrangement to reduce or eliminate barreldistortion of captured images by the fisheye lens. The access port 38can also provide a conduit for heat exhaust. A fan may be located at thecore 39 of the VLSIC sensor to push exhaust heat build-up. Heat sinkscan also be located at the core. A hollow tube made of a metal orplastic arrangement is constructed to support the sensor. The sensor isassembled and disassembled at the seam.

In operation the VLSIC sensor 32 is driven by a local or remote user 22operating an input device that transmits x-y-z coordinate pan and zoominformation to the sensor 32. In operation the VLSIC is the input devicewhich captures images operated upon for eye cracking to determine pointof view image sampling and readout. The VLSIC operates upon theeye-tracking data and outputs coordinate yaw, pitch, and roll data tothe VLSIC that defines the scene to be sampled by the ROI portion of theVLSIC. The positional data defined is operated upon by the VLSIC toactivate the LED to display images or remain transparent. If an area onthe LED is transparent 122 then eye tracking data on one side of thesensor is collected to determine where the user is looking, which inturn causes the VLSIC sensor to make transparent the area of the LED inthe direction of where the onlooker 36 and subject 37 are located suchthat images in the FOV are reflected through the fisheye lens to thelight sensitive surface of the VLSIC. Whenever an LED is transparent acorresponding ROI will be activated to read out the transmitted image.Multiple ROI's may be read out depending on the commands coming from theinteractive input device. In this manner a remote user can pan and zoomaround a live panoramic scene of a user wearing system 4 a who iswearing the system apparatus 1 in another location. For simultaneousrecording of the entire spherical scene a user must command the sensor32 to leave all LED's transparent. When all LED's are left transparentan image like that shown in FIG. 24b is derived. But when only someLED's are left transparent only portions of the entire spherical FOVimage are captured. Those skilled in the art will know that besides eyetracking the VLSIC sensor may be programmed to conduct region ofinterest sampling of the surrounding environment, such as the usersface, hand gestures, an onlooker 36 or other subject 37. The activeopaque LED's 123 displaying imagery are designated by arrow 40 and theinactive LED's that are transparent are designated by arrow 41, and theusers view of the onlooker and subject is designated by dashed lines andarrow 42. In some instances it will be advantageous to only capturesmall ROI to reduce the processing power required by the VLSIC, increaseprocessing speed, and reduce the size of the image area to be sent toreduce corresponding bandwidth requirements for sending the ROI.Additionally, the core 39 of the VLSIC sensor may include an electricalstorage battery, heat sinks, wireless radio frequency transmitter,additional memory, processors, and the like. Technologies that areincorporated in building the present spherical FOV sensor described inthe present invention is disclosed in US Patent Application Publications2008/0030573, dated 7 Feb. 2008, and 2008/0007617 A1 dated 10 Jan. 2008,by Ritchey, both entitled “Volumetric Panoramic Sensor Systems”.

FIGS. 13a-b are schematic diagrams that illustrates one lens of theintegrated micro-bead array optic 43′ and LED display optic 34′ andVSLIC image capture 32′; embodiment of the invention apparatus 1. Thediagram illustrates one optic that comprises the micro-bead array. Inthis example, the optic comprises the exterior of the sensor assemblyand armature. FIG. 13a illustrates image capture. FIG. 13b illustratesimage display. As illustrated in FIG. 23a-b -3, the imagery displayed isreflected to the either eye of a user 22 or onlooker 36 based on eitherpersons viewing angle to the sensor assembly 2. In our presentembodiment the sensor assembly displays imagery captured on the oppositeside of the assembly so that an unobstructed view of the foreground isdisplayed to a user 22. Because the users eyes, designated by eye leftEL and eye right, ER are at a different location than the sensorassembly, for masking purposes the image offset must be calculated sothat the displayed foreground imagery in the viewers line of sightmatches-up accurately with the actual real-world foreground. Ifrequired, image offset processing and calculations are determined on theVLSIC CPU processor or a remote electronic device. U.S. Pat. No.5,724,758, dated 6 May 1998, by Gulick, Jr. and U.S. Pat. No. 2,833,176,dated 21 Jul. 1953, by A. J. L. Ossoinak entitled disclose an opticalsystem that is incorporated into the present invention as shown in FIGS.13a and 13b for recording and displaying imagery auto-stereoscopically.The image recorded by each optical bead is project out from the displayin the same orientation it was recorded on the other side of thearmature 3 and sensor assembly 2 from whence it was recorded. The effectseen by the user 22 is that the armature and sensor are masked and thata scene is displayed that blends into the real world foreground. Asystem with the same optical FOV coverage as illustrated in FIGS.13a-13b is preferably incorporated into FIG. 14a and FIG. 14b to achieveauto-stereoscopic coverage of the armature 3 and sensor assembly 2.

Optionally, other integrated image capture and display systems presentedfound in prior art which have not been used in the novel, useful, andunobvious manner presented in the present invention may be incorporatedonto the armature and sensor assembly without departing from the spiritof the present invention. For instance, U.S. Pat. No. 7,808,540, by Cok,dated 5 Oct. 2010, entitled “Image capture and integrated displayapparatus”; U.S. Pat. No. 7,714,923 entitled “Integrated display andcapture apparatus; and U.S. Pat. No. 7,697,053 entitled Integrateddisplay having multiple capture devices.

The present invention may incorporate any one of a number of traditionaleye tracking or head tracking systems to drive the operation ofapparatus 1 drive the sensor assembly 2, and drive an audio-visualdisplay in the present invention. Many navigation systems, surveillancesystems and weapon systems provide a user with a video image of a regionof interest from which the user may wish to designate an object orfeature for tracking. The eye tracking system monitors the position of auser's eye within its socket in order to determine the user's line ofgaze. The gaze information is used to control the servos dial controlthe position of the armature and sensor assembly by eye movements and todetermine what the user is watching. A first embodiment according to thepresent invention incorporates a tracking system 12 worn by the user totrack the eyes of the user, as shown in FIG. 4. A second embodiment inthe present invention incorporates the use of the sensor assembly 2 totrack the eyes of the user, as shown in FIG. 17a . From either of theseeye-tracking methods data is provided to device 44 to drive theapparatus 1 or alternatively provided directly to the motors on theapparatus 1 to drive the positioning of the armature 3 with the sensorassembly 2.

One technique for monitoring the eyes of the user includes the so-calledcorneal reflection (CR) method in which a point light source is used toproduce a bright image on the anterior surface of the cornea, and atracking system monitors the position of the image. However such amethod has been found to be very sensitive to errors induced by sensormovement. As an alternative the so-called differential CR/pupil trackingmethod has been developed in which the relative positions of the pupiland a corneal reflection are monitored by a suitable camera, awavelength-sensitive beam splitter being used to ensure that the user'sview is not obstructed by the light source and camera. Such a method isless sensitive to sensor movements. Generally the eye is illuminated bya near infrared source (or multiple sources) and a solid state videocamera captures an image of the eye. In so-called bright pupil imagingthe light source produces a light beam which is coaxial with the cameraaxis, and light reflected back from the retina making the pupil appearto be a bright circle, the apparent brightness increasing roughly withthe fourth power of pupil diameter. In so-called dark pupil imaging thelight source produces a light beam which is off axis relative to thecamera axis, and a dark pupil image is produced. Real time imageanalysis is used to identify the pupil and corneal reflections and tofind their centers.

A portable target tracking and pointing device of a type that can beincorporated into present invention to facilitate recording designationinclude the eye tracking system generally described above andspecifically described in U.S. Patent Application 20040196433, byDurnell, dated 7 Oct. 2004, titled Eye Tracking System, and in U.S.Patent Application 20080205700, by Nir, dated 28 Aug. 2008 titledApparatus and Method for Assisted Target Designation which includesvideo designation and tracking via imagery and/or directional audio. Theabove systems referenced in this paragraph produced information that canbe digitally stored and processed by the computer of the portablewireless device 44. The eye tracking, gaze, directional FOV, distance offocus, and GPS in derived from the referenced systems described in thisparagraph can be operated upon by the device 44 or directly sent to theapparatus to position the armature. Other art that may be incorporatedinto the present invention is the Ultra-Vis, iLeader, system developedby ARA, subsidiaries MWD, Vertek, and KAD, and other companies toinclude Lockheed Martin and Microvision Incorporated. The portableiLeader system includes a HMD system with a micro-laser range findersystem for target designation, see through eyewear, head and eyetracking system, waveguide display googles, video cameras for recordingthe view the user is seeing directly ahead of where he is looking,helmet electronics, eye tracking and target designation system, voicemics and earbuds, and an associated electronics unit with to control theHMD, telecommunications network and GPS interface, iGlove, battery powerand sensor feed, and a soldier augmented reality (AR) system. In theusers see-through HMD of the iLeader system, the system is operated bythe user to designate and record targets in the surrounding environmentand overlay information on a see-through display. The overlaidinformation displayed to the user may be from associated sensors theuser is wearing, sensors other users are wearing, or from otherinformation on networked devices that is wirelessly transmitted from aremote location that is part of the telecommunication system and networkthat includes the iLeader system. Technology of a type disclosed in theiLeader system is consistent with and may be incorporated into thepresent invention. However, the iLeader system and none of the abovesystems incorporate the elements for driving an apparatus fornon-interference FOV panoramic hands-free face-to-face videoteleconferencing.

FIGS. 14a-b are side sectional views of another embodiment of anaddressable ROI integrated audio-visual capture and display systemcompatible with the present invention. A digitally driven micro-mirrordevice used in the present invention for projection of a type that isused in the present invention to reflect the image is of a typemanufactured by Texas Instruments Inc as a DLSP. Each photo diode 50,photo sensor 52, and micro-mirror reflector/shutter 47 are addressableby a computer electronic control assembly/CPU that is integrated intothe VSLIC 31 or optionally electronic device 44. As shown in FIG. 14a ,in operation a micro-mirror shutter is closed to reflect an incomingimage transmitted through an objective lens and relay lens to an imagecapture sensor. In FIG. 14a light rays 48 from a subject image arereflected through the micro-bead lens array 43, through open micromirror shutters, and to a photo sensor 52. Sensor 52 reads out theimagery through video drive circuitry 49 of the hose computer to the CPUof VLSIC 31 or device 44. Micro-mirror DLSP shutters are open and closedin response to commands by the VLSIC or device 44. Commands to open andclose the mirrors and emit an image or capture an image are determinedby the hands free input devices. Or alternatively, as shown in FIG. 14b, in operation a micro-mirror shutter is open to reflect an outgoingimage 53 from an LED photo diode through a relay optic 46 and anobjective lens 43′ of the micro-lens array 43 to a viewer. LED 55 photodiode circuitry reads out the imagery through LED display drivecircuitry 49 of the hose computer to the CPU of VLSIC 31 or device 44.Micro-mirror DLSP shutters are open and closed in response to commandsby the VLSIC or device 44 to reflect an image to the eye of a local user22, onlooker 36, or a remote user 22′. Commands to open and close themirrors are issued through the micro-mirror drive circuitry 54 to openand close to facilitate emitting an image or capturing an image aredetermined by the hands free input devices. Input devices include suchas sensor 2, eye tracking 12, voice to text recognition, sub-vocal, andneural sensing systems integrated with device apparatus 1 and consistentwith the objectives of the present invention. The lens array 43 may beintegrated into a rigid or flexible material. Integrated and adjacentthe fisheye lens is an addressable transparent Organic Light-EmittingDiode (OLED) or Light-Emitting Diode (LED) display known to thoseskilled in the art. Such LED and OLED displays are typically used inhead mounted displays in which graphics are overlaid over the real worldbackground observable through the LED display. The LED display isdesigned such that it may be operated as a shutter to block light thatentering the fisheye lens or alternatively to allow light to enter thefisheye lens. Additionally, the LED may be operated as a visual display.It is known to those skilled in the art that addressable LED, LCD, DLP,or SLM's may be used interchangeably in the present invention asshutters or a display in the present embodiment.

FIG. 15 is a diagrammatic plan view of the invention apparatus 1 mountedto augmented reality eyeglasses 7 and a portable electronic device 44and illustrating the spherical field-of-view of the sensor 2. Theportable device 44 includes a computer 56 for operating the portabledevice and hosting the panoramic support device apparatus 1. Theelectronic device includes a transceiver 58 and antenna 57 forconnecting wirelessly to a mobile telecommunications network. Theelectronic device also includes a portable battery 59 to provideelectrical power to the mobile electronic device 44. The panoramicsupport device apparatus 1 is worn by the user 22 to simultaneouslyrecord the face of the user and the surrounding environment thusenabling mobile face to face panoramic video teleconferencing. Thearmature 3 is of a length that enables the positioning of the sensor ata distance from the face of the user that continuous FOV coverage isachieved. The lines 60 indicate the dead space between the objectivelenses where no imagery is recorded. The lines of overlapping coverageand minimal focus distance is a function of the objective lensesincorporated in the present invention. The overlapping of the FOV of theadjacent objective lenses is indicated by lines 61 in the diagram.

FIG. 16 is a plan view of the invention apparatus 1 mounted to a support7 worn on the head of a user and illustrating the sphericalfield-of-view (FOV) coverage of the panoramic sensor 2 to the users facewhen in lowered to the forward position.

FIG. 17a-c is a perspective view of the eye-tracking embodiment of theinvention. In the illustration the prime notation indicates camerarecorded imagery versus real world imagery. In FIG. 17a the inventionapparatus 1 is mounted to the user's eyeglasses 7. As shown in FIG. 17bthe sensor assembly 2 is blocking some of the high resolution visioncone FOV 42, which corresponds to the users vision cone for high ocularacuity and fine focus. FIG. 17 c illustrates the scene recorded bysensor 2 which includes two back to back 190 degree fisheye lenses andtheir associated image sensors in the present example. The resultinghemispherical images. The sensor assembly 2 records imagery of the EL orER of the user's eyes and processes the imagery in computer 56 of thehost portable electronic device and determines the coordinates of theusers view. The derived coordinates of the view of the user 22 areoperated upon by ROI processor in sensor assembly 2 to sample out ROIimagery corresponding to the users focus. The ROI imagery sampledcorresponds to the high resolution vision cone 40 in the eye of theuser. The imagery from the sensor is operated upon additional processorsto mask the sensor assembly 2, move the armature 3 out of the highresolution vision cone FOV of the user, or sample imagery out forface-to-face panoramic video teleconferencing, interactive gaming, orvideo logging applications. In the illustration the prime notationindicates camera recorded imagery versus real world imagery.

FIGS. 18a and 18b are a side and plan view diagrams respectivelyillustrating the FOV and the armature and sensor positions available tothe user operating the present invention. The armature 3 and sensor 2are either manually adjusted or interactively adjusted to the preferenceof the user 22. Alternatively the user may be located remotely andcontrol the position of the armature and sensor by sending electroniccommands to the host device 44 and device apparatus 1 over atelecommunications network. Positions 1 through Position 6 illustratevarious locations the user may rotate the armature 3 and sensor assembly2 within his or her Wide FOV 62 or Narrow Field of FOV 40 or completelyoutside the FOV. The sensor assembly may be rotated to Position 6 overthe users head and outside the users FOV to record the area surroundingthe user. Or alternatively, the user may rotate the sensor assembly toPosition 1 to store the sensor assembly outside the FOV of the user. Tointeract with the surrounding environment it Position 4 or Position 2are preferably selected as they are outside the fine field-of-focus 40of the user 22, but still keep the sensor in a position to track theusers eyes and record the face of the user in order to conduct mobileface-to-face 2-way panoramic video teleconferencing. Position 3 isinside the narrow field of view 40 of the user and the armature andsensor assembly will block the user's view of the foreground unlessmasked in some manner. It should be noted that the extendable androtatable portion 66 of the device apparatus 1 may be constructed tostep to specified positions or to any position along the rotation path.

FIG. 19 is a illustration of a screen shot of the graphic user interface(GUI) 64 of on a host digital communication device 44 (i.e. an (Phone)to be acted upon by the user 22 to interactively control the rotatablearmature and spherical sensor and content thereof according to thepresent invention. The graphic user interface includes a menu screenentitled “Activation Selection” 65 feature the user manually selects byusing a touch screen to set the parameters of the device apparatus. Theinterface 64 also includes a “Position Selection” 69 feature the usermanually selects by using a touch screen to set the parameters of thedevice apparatus 1. A dotted line 68 is used to indicate the wide FOV ofthe user 22. A graphic of the face of the user 22 and the sensorassembly 2 in various positions is provide on the GUI to assist the userin making his sensor assembly position selections. A dashed line andarrow 67 indicates the center point of the user 22 fine vision cone 40.The user issues commands to device 44 to set position parameters of thearmature 3 with sensor assembly 2. Preferably, the user set the positionof the armature with sensor assembly so that it is just below or abovehis or her fine vision cone in front of his face. Also, preferably theuser sets the proximal end of the armature with sensor assembly at adistance that optimally accommodates his or her near FOV focus so thatthe user can read text or focus the graphics or imagery on the display112 if a display is mounted on the armature or sensor assembly. Once theuser sets the parameters the device will automatically adjust thesupport device 1 to the settings of the user whenever the device isactivated. FIG. 29a illustrates the system being set so that the usermay look down to read the display 112 at D1, and then glance up to viewsubjects at distance D2 in from of the user at the mid and far FOV infocus. The options are listed on the touch screen and the userinteractively selects them. When the user touches a topic and it changesfrom red to green the application is activated. By touching theapplication again the topics text turns red and the application isturned off. Multiple related functions may be selected to enable ordisable applications that run simultaneously. The user has the option toselect options which make operating the device in a hands-free manner.In some applications like “Named Feature” or “Named Correlate” adatabase of features or correlates that are searched upon to drive therotatable portion of the device apparatus 1 is required to be textedinto the GUI in order for the application to function. The GUI alsoincludes “Zoom” and “Pan” 65 functionality. The user presses the arrowson the touch sensitive screen of the device 44 to pan the spherical FOVscene, or presses the center button to zoom in and out on an item.Alternatively, the operation of the user interface be done hands freeusing the voice recognition system, sub-vocal recognition system, handor facial gestures, or the brain activity sensor system.

FIG. 20 is a block diagram of the interaction of the components of thepresent invention specifically shown in the structural details of FIGS.1-9 b discussed earlier in the specification. In operation an incomingor outgoing phone call over the telecommunications network 70 willactivate the wake-up feature on the wireless mobile device 44. Thecentral processing assembly 56 activates the sensor interface module 71to extend and rotate the servo S1 and S2 respectively to position tomove the extendable and rotatable portion of the device 66 of thepanoramic support device apparatus 1 into a predetermined position. Theposition will have been predetermined by the user 22 using the graphicinterface device as described in FIGS. 18 and 19. Optionally, an eyetracking sensor 12 may be attached to the device as shown in FIGS. 3 and4. The central processing assembly 56 will also command the sensorinterface module 71 to activate the spherical FOV sensor assembly 2.

The invention is operated by the user to interactively raise/lower,extend/retract an armature and sensor for mobile face-to-face panoramicvideo teleconferencing, teleprompting, or data logging. The sphericalFOV assembly 2 operates to provide imagery and audio to the wirelesscommunication device 44 that is operated upon by the processing assembly56. Either the eye tracking sensor 12 or the sensor assembly 2 may beoperated to provide coordinate information on where the user 22 islooking with his or her eyes. Typically the user has previouslycommanded the device using the GUI to move the sensor and armature outof the users fine-focus FOV. Additionally, the processing assembly 56communicates with sensor assembly 2 to sample video from the ROI CMOSsensor to satisfy the GUI 64 settings the user has previously input intodevice 44. A remote user 22′ may also command the device 44 of the localuser 22 to send video to his or her remote device 44′ should the user 22give the remote user 22′ permission to access such information of thelocal user 22. The user 22 authorizes the remote user 44 allows theremote user 22′ remote access by granting permissions on the device 44via the GUI 64.

FIG. 21 is a block diagram of another embodiment showing the interactionof the components of the present invention specifically shown in thestructural details of FIGS. 10a-17c discussed earlier in thespecification. In addition to the operation described in FIG. 20, thedevice apparatus 1 includes a display 34. In the present example thedisplay 34 covers the exterior of the armature 3 and sensor assembly 2.Flexible LED and OLED of a type that may be glued or fastened to thearmature 3 and sensor 2 are known to those in the flexible displayindustry and may be incorporated into the present invention. The LEDdisplays foreground information processed by an image processing module72 in the wireless communication device 44 or alternatively byprocessing means integrated into the armature and sensor as described inFIG. 11a -FIG. 17c . The LED is operated to provide graphic, text, imagedisplay and illumination. In this manner the panoramic support deviceapparatus 1 provides further structure capable of producing anunobstructed view to the user 22 operating the present invention forpanoramic mobile face-to-face panoramic video teleconferencing or datalogging.

FIG. 22 is a block diagram another embodiment showing the interaction ofthe components of the present invention apparatus 1 specifically shownin the structural details of FIGS. 23a-29d of the remainingspecification. In addition to the operation described in FIG. 21, thedevice apparatus 1 includes a LAN 79 multi-channel transceiver, such asBluetooth means, for receiving and sending a plurality of wireless datatransmissions to input sensors that drive the operation of theNon-Interference Field-of-view Support Assembly for Panoramic FacialSensor that comprises the present invention. In operation the wirelesscommunication device 44 also includes a neural sensing module 73 foridentifying neural correlates of consciousness from brain signatures;voice recognition module 74 for processing speech commands or sub-vocalsignatures; an image processing module 72 for eye tracking, facialimaging, feature tracking, and panoramic imaging, and a servo controlmodule 75 and interface module 71 that are centrally commanded by thecentral processing assembly 56. Transceiver 79 transmits data, typicallyby radio frequency data link 76, to the wireless on body servomechanisms, sensors, and displays which have a built in transceiver thatform the collective support assembly 82 located on the user 22 and 22′.The image processing module 72 operates upon information that istransmitted to the contact lens display(s) 77 located in or on the userseyes. The image processing module 72 operates to define the users visualFOV and subjects of interest for tracking based on information receivedfrom the spherical FOV camera with ROI tracking, display, and processing2. Data derived from the image processing module is sent to the servocontrol module 75 which is in turn sent to transceiver 79. Transceiver79 transmits the data to servo S1 and S2 to control the positionarmature 3 and sensor 2. Similarly voice sensor and neural sensor datais operated upon to control servos and associated armature and sensorpositioning. Conflicts between sensor commands are resolved by thecentral processing assembly 56 or the interface module 71. The purposeof the computer processing unit (CPU) 56 is to serve as the mastercontrol system for all modules of device 44 which commands and controlsapparatus 1. The arm assembly includes an electrical plug mated tocouple with the socket. The armature is operated by at least one motorwhich turns a torque rings to move the armature. By turning the torquering the motors can move the armature vertically to be in or outside thewearer's fine focus field of view. The modules of device 44 communicatewith the CPU 56 over a bus. Device 44 includes a battery module, whichsupplies dc power to the computer modules.

The purpose of the interface module 71 is operates to route incoming andoutgoing signals between the device 44 and on body user mountedmechanisms, sensor, and display systems with transceivers 82. It will beknown by those skilled in the art that there are many tradeoffs infunctionality of the invention that may be realized in firmware orhardware. For instance, the image processing module may be integratedsolely in firmware resident to the CPU 56 and not include a separateprocessing module 72. Additionally, functionality may be divided upeither on the wireless communication device 44 or integrated into thewireless on body mechanisms, sensors, and displays with transceivers 82without departing from the spirit of the present invention. For instanceROI processing can be placed on the sensor 2, image processing module72, or divided up on both. These are tradeoffs the designer of thesystem may make in tailoring the system to a particular application.

FIG. 23a and FIG. 23b 1-3 are diagrammatic perspectives illustratingclipping a portion of the foreground image from the image recorded bythe spherical sensor, calculating the offset, and clipping and displayof the foreground image between the users eyes ER and EL on his or herhead mounted, eye mounted or electronic contact lens displays such thatthe foreground image fills in and masks the portion of the sensor 2 andarmature 3 blocking the field-of-view of the user. In the presentexample shown in FIG. 23a the clipped images displayed in focus on thesee through augmented reality (AR) glasses of the user 22. The clippedimagery may be displayed on see through AR display systems such ashead-mounted display HMD, on eye electronic contact display, or in eyeimplanted display system.

As shown in the diagrammatic perspective in FIG. 23b 1-3 graphicallyillustrates the basic steps in image processing and display that occurson the image processing module 72. Imagery recording face and eyes ofthe user is recorded by fisheye 24 a. Foreground imagery blocked fromthe FOV of user by the sensor and armature is recorded by the sensorfacing opposite the user, in this instance fisheye 24 b. The location ofthe sensor is determined by photometric computer processing of the userseyes, the armature, and foreground portion of the scene shown in FIG.24a or FIG. 24b that comprises the composite panoramic scene recorded bythe panoramic sensor. The image processing module uses feature trackingfirmware to determine the location of the user's eyes, FOV, sensor andarmature. As depicted in FIG. 12b graphic markers 90 of various shapes,may be displayed on the LED surface to assist the target tracking systemin locating the armature and sensor in space. As shown in FIG. 23b 1photometric image processing operations are performed by the imageprocessing module to sample out the shape of imagery 2′ shown in FIG.24a or FIG. 24b in the panoramic scene that is blocked by the sensor andarmature. The clipped shape imagery 2″ is then interlaced into thepicture signal 91 at the location the picture is being blocked by thesensor and armature. As illustrated in FIG. 23b 3 resultant imagery 2′″read out for display on the eyeglasses provides and uninterrupted sceneof the foreground, here the face subject 36, that is opposite the userin the local surrounding environment. Device 44 preferably operates onthe image recorded by the sensor to clip images of the user's bodywithout the background and overlays the images over the geographicinformation or in an appropriate space. An overlaid silhouette or aphotograph of the users may be selected using an input device that isintegrated with computer 4 to initiate the video teleconference.

The clipped imagery 2″ and 2′″ preferably comprise a live videorepresentation of the subject during the video teleconference. Aportable wireless computerized video clipping system for augmentedreality overlay onto a graphic or video background of a type consistentwith the present invention that may be incorporated into the presentinvention is was presented at the International Society for Mixed Mediaand Augmented Reality Symposium 2001 (ISMAR 2001) by Hirokazu Kato etal. of Hiroshima City University, Japan,kato@sys.im.hiroshima-cu.ac.jp., entitled Block Assembly in AugmentedReality. The image processing portion of the system operates to produceand readout a EL and ER image for display on the AR glasses. Theforeground imagery is then over-laid on display between user and thepanoramic lens and armature. U.S. Pat. No. 6,307,589 by Maguire, Jr,dated 23 Oct. 2001, entitled “Head Mounted Camera with Eye Monitor andStereo Embodiments Thereof”; US Patent Publication 2003/0210228 A1 byEbersole et al., dated 13 Nov. 2003, entitled “Augmented RealitySituational Awareness System and Method”; and the above mentionedISMAR2001 video teaches the manipulation of imagery recorded by sensor 2of apparatus 1 according to the present invention. In the presentinvention facial and panoramic information captured by sensor assembly 2are operated upon using the image processing of a type referenced in theabove art and incorporated into the present invention for use in theaugmented reality systems and for hiding the sensor as described inFIGS. 23a -25.

FIG. 24a is a sample of one raw video frame 83 which includes twohemispherical images Side A and Side B recorded by the two back to backfisheye lenses 24 a and 24 b of the panoramic image sensor 2 in FIG. 1.Barrel distortion of the two hemispherical images is caused by theoptics of the fisheye lenses. The edge of the ROI 88 sampled out by theraw image 83 is indicated by a curved dashed and dotted line.Obstruction of the background FOV is caused by the armature 3, asillustrated by the image of the armature 3′ in the raw video frame 83.

FIG. 24b is a sample video frame 85 in which a computer system withimage processing firmware has processed the image shown in FIG. 24b .The edge of the ROI 88 sampled out by the raw image 83 is indicated by arectangle with a dashed and dotted line. In FIG. 24b image processingalgorithms have operated upon the image 83 to create image 85 forreadout and display to the user. In image 85 barrel distortion has beenremoved, the images has been translated into the proper orientation,stitched together, and placed side by side one another. Those skilled inthe art will realize that computer operations to prepare a barreldistorted image for display to a user may initiated on a ROI sampled outat any time after recording a portion or the entire image depending onthe design of the invention. The image processing system 72 may befurther operated to remove the imagery of the armature 3 out of thebackground of final displayed scene shown to the user. This is done byfirmware operating to interpolate the imagery surrounding the armatureto replace the background scene so that the finished image in frame 85appears to be uninterrupted by the image of the armature 3″.

Alternatively, imagery captured using the image capture functionalitydescribed in FIG. 13a-b and FIG. 14a-b may be processed. In such anembodiment a portion of the imagery captured from the side of thearmature facing outward from the user is sampled for insertion into thefinal frame displayed to the user to hide the portion of the armatureblocking the FOV of the user. The resultant frame 85 illustrates theresultant image displayed to the user in which the imagery of thearmature 3″ is removed from the scene by interpolating and interlacingthe background scene captured by the sensor 2.

FIG. 25 is a schematic diagram illustrating a two-way teleconferenceenabled by users operating the present invention apparatus 1. Distortionremoval may be accomplished in any of several ways. In the presentembodiment of the invention that uses two fisheye lenses to sample ROI88 from the composite panoramic scene the local user 22 or the remoteuser 22′ has interactively selected. The images are interactivelyselected by the target tracking the direction and distance of the FOVcoordinates the eyes of the user. The image processing system 72operates on these coordinates to sample out the image for processing anddisplay. Algorithms which predict the direction and distance of wherethe user may look next may also be included in the firmware to enhancethe responsiveness of the invention apparatus 1. The region of interest(ROI) 88 image sampled out may be a barrel distorted image 5 from frame83 or from a barrel distortion corrected composite image 85 as depictedin FIGS. 24a and 24b , respectively. In the present example ROI 88 inFIG. 24a is sampled out of as raw barrel distorted image 5, and thenfirmware is used to remove the image distortion in ROI 88 in FIG. 24byielding an undistorted image 7. Device 44 operates module 72 to renderthe undistorted image 7. In the present example the distortion isremoved from image 5 solely by a computer firmware or softwareapplication program running on the electronic device 44 image processingmodule 72 that comprises algorithms that remove the barrel distortionfrom the captured image(s) and perform other panoramic image processingfunctions. Alternatively, distortion removal is accomplished opticallyby using fiber optic conduits with non-uniform magnification (i.e. aFibreye™ arrangement). Alternatively a panomorphic lens arrangement andaccompanying firmware may be used to remove distortion. It should benoted, still alternatively, designs of the system may be implemented inwhich objective lenses capture images with no or very little distortion,obviating the need for distortion removal optics or software/firmware.It should be noted that the image processing firmware may be integratedonto the sensor in the form of a VLSIC as shown in FIGS. 12a-12c . Anyof the techniques or a combination thereof may is incorporated into thepresent invention to remove the distortion displayed to user 22 and 22′.The image capture device may be integrated into a traditionaltelecommunication network 70 and system that is designed to facilitatemobile wireless video teleconferencing.

FIGS. 26 thru 29 illustrate several embodiments of how the inventionapparatus 1 is integrated with a portable electronic device 44. FIG. 26is a perspective illustration of an embodiment in which the presentinvention is connected by cable to host electronic device 44. The device44 may be a conventional cell phone or personal digital assistant withpanoramic video teleconferencing capability. A device 44 compatible withand integrated into the present invention is the iPhone 4S manufacturedand sold by Apple Computer Inc., 1 Infinite Loop, Cupertino, Calif.95014. In FIG. 26 the device 44 operates to transmit data and videosignals over a standard insulated wired communication cable 8 like thatdescribed in FIG. 20 and FIG. 21. Data is transmitted to and from thesupport assembly apparatus 1 with panoramic sensors through a cable 8 toat least one connector that plugs into device 44. In the present exampleaudio captured from at least one microphone located on the sensorassembly is transmitted through wiring circuitry to the 3.5-mm stereoheadphone mini-jack 94 for audio input/output located on the device 44.In this manner the voice of the user 22 is captured for transmission tothe remote user 22′. Audio from the remote user is transmitted in theopposite direction over cable 8 to at left and right earbud 92 a and 92b (not shown) worn by the user. In this manner the voice of the remoteuser 22″ is transmitted from device 44 for presentation to the localuser 22 as illustrated in FIG. 25. Video imagery and other control datais also transmitted to and from the sensor assembly 2 and armature 3 andother sensors worn by the user through cable 8 to the to the electronicdevice 44. In the present example video imagery and other datatransmitted between sensor 2 and device 44 is input and output overcable 8 through a 30 pin dock connector 93 located at the bottom of thedevice 44. Electronic devices that comprise the panoramic supportassembly apparatus 1 mounted in, on, or worn by the user alsocommunicate over cable 8 to device 44. For example, as illustrated inFIG. 20 and FIG. 26 servo S1 that rotates and servo S2 that extends thearmature 3, display 34, and spherical FOV camera 2 video (includingaudio and imagery) and optical eye tracking sensor 12 that are incommunicating relationship with device 44 are powered and commanded viatransmissions over cable 8. The eye tracking sensor 12 readout and videosignal input to the augmented reality display eyeglasses 7 are input andoutput over a standard data transmission cable 13. As previouslydescribed in FIG. 3 cable 13 includes a connector 11 at one end thatplugs into housing 4 of the support assembly apparatus 1. The connectorhas contacts that plug into a female socket in the housing that transmitthe signals from cable 13 to wires in cable 8. It will be realized tothose skilled in the art that wires in cable 8 may be substituted with afiber optic conduit communications system. A single or plurality ofservo 5 are incorporated to move the armature and sensor assembly.Alternatively or additionally, the support assembly shown in FIGS. 1-2may be designed with a manually adjustable swivel and pull out extensionso that the user can adjust the armature and sensor assembly to adesired position. However, the later arrangement will mean a lesshands-free operation of the invention.

Still referring to FIG. 26, wires in cable 8 may be separated out atdevice 44 to transmit signals for input and output as appropriate viathe 30 pin connector 93 and the headphone mini-jack 94. Preferably, thecable 8 also provides electrical power to devices comprising inventionapparatus 1 that are mounted in, on, or worn by the user. A portablebattery may be docked with device 44 to provide additional electricalstorage to power to the devices that comprise the panoramic supportassembly apparatus 1. Because an objective of the device is tofacilitate hands free face-to-face interaction the device 44 ispreferably placed in a pocket or holster on the user 22. In operation awake-up feature alerts the user of an incoming video telephone call andautomatically positions the armature with sensor for portable panoramicvideo teleconferencing to commence. Likewise the user may verbally orfacially interact using audio and image sensors that are part of thesupport assembly apparatus 1 to operate device 44 to activate the voicerecognition system and a personal assistant that learns system, like theApple Inc. SIRI system on iPhone 4s, to conduct internet searches andconduct other tasks in a portable hands-free manner. Siri(pronounced/.sup.smallcircle.siri/) is a personal assistant applicationfor iOS. The application uses natural language processing to answerquestions, make recommendations, and perform actions by delegatingrequests to an expanding set of web services. Siri claims that thesoftware adapts to the user's individual preferences over time andpersonalizes results, as well as accomplishing tasks such as makingdinner reservations and reserving a cab. Siri was originally introducedas an iOS application available in the App Store. Siri was acquired byApple Inc. on Apr. 28, 2010.

FIG. 27 is a schematic perspective illustrating that device 44 and thepanoramic support assembly apparatus 1 communicates over a cellular andwireless network. Wireless communication to the device 44 isaccomplished by using the following technologies: UMTS/HSDPA/HSUPA (850,900, 1900, 2100 MHz): GSM/EDGE (850, 900, 1800, 1900 MHz); CDMA EV-DORev. A (800, 1900 MHz): 802.11b/g/n Wi-Fi (802.11n 2.4 GHz only);Bluetooth 4.0 wireless technology, world phone, or the like. Forexample, in operation a radio frequency 76 wireless communication system79 like that described in FIG. 22 transmits over-the-air command andcontrol data signals between the support assemblies with panoramicsensors and audio-visual displays that comprise the invention apparatus1. In FIG. 27 housing 4 includes a transceiver to send and to receivethe radio frequency signal transmitted to and from device 44 over a WIFIor cellular connection. An incoming signal from device 44 is separatedout by a de-multiplexer to command each appropriate device. An outgoingsignal is consolidated and sent to device 44 after the signal from eachdevice is multiplexed. U.S. Patent Application Publication 1007/0211148;by Lev et al, dated 13 Sep. 2007, discloses a communication system thatis of a type that may be incorporated in the present invention for usein communicating between device 44 and the composite group of body wornsensors, displays, and wireless transceivers 82 in order to realize thepresent invention.

In contrast, as illustrated in FIG. 22 and FIG. 28a illustrates amulti-channel wireless connection between a portable electronic device44 and the collective wireless on body devices 82 situated on or in theuser 22. Devices 82 included worn on the user include neural sensors,voice recognition sensors, and audio-visual sensors described in FIG.22. For example, servo S1 that rotates and servo S2 that extends thearmature 3; sub-vocalization sensors 80 located on the users throatrecord and transmit sub-vocal signatures; neural sensors 81 record andtransmit fMRI signatures, electronic contact lens displays 77 receivesvideo imagery for display; spherical FOV camera 2 records panoramicvideo imagery using fisheye lenses 24 and audio using microphones 25;and conducts ROI image tracking, processing, and display from theimagery recorded by the camera 2; that are all in communicatingrelationship with device 44 and are commanded via transmissions overwireless link 76. Electrical power is provided to assembly 82 viabatteries installed separately with each device or via wiring harnessthat includes circuitry that routes electrical power to each device ofthat makes up each of the devices that comprise the worn supportassembly 82. To facilitate communication between support assembly 82 andthe host electronic device 44 is preferably placed in a pocket orholster on the user 22. Assembly 82 may preferably include an input andoutput port, like a mini-USB or a 30 pin connector port to allowrecharging and updating of firmware. The wireless on body mechanisms,sensors, and displays with transceivers 82 comprise the electronicdevices worn by the user. The communication link may be a single ormulti-channel transmission. If a single transmission link is used hesignals are broken out into packets and routed to the appropriate deviceS1, S2, 80, 81, 2, and 77 that makes up the support assembly 82.

Components that are used to realize the system in described in FIGS. 22and 28 include the following: An electronic contact lens 77 mounted onand/or inside the eye compatible for use in the present invention isdisclosed in US Patent 20090189974 A1, by Michael F. Deering, dated 30Jul. 2009, and emitted Systems Using Eye Mounted Displays. U.S. Patent20080056517 by Algazi et al, dated 6 Mar. 2008, entitled DynamicBinaural Sound Capture and reproduction in focused or FrontalApplication that is of a type compatible with and incorporated in thepresent invention. The Apple iPhone voice recognition system andmicrophone with earbud are compatible and may be incorporated to realizethe present invention. Another embodiment and component of the systemincludes a sub-vocalization system. Sub-vocalization is the tendency ofa user to silently say individual words to themselves as they read orthink. Sub-vocal recognition (SVR) is the process of takingsub-vocalization and converting the detected results to a digitaltext-based output. It is similar to voice recognition except it issilent sub-vocalization being detected. A sub-vocalization system of atype that may be incorporated into the present invention as a componentdisclosed in U.S. Pat. No. 6,272,466, dated 7 Aug. 2001, by Harada, etal., entitled “Speech detection apparatus using specularly reflectedlight” and that described in the ongoing NASA Sub Vocal Recognition(SVR) program began in 1999, and later renamed the Extension of HumanSenses program. In the NASA program muscles of the vocal tract (e.g.electromyographic or EMG) signatures are sensed by contact sensorsplaced on the throat (either internally or externally to the body). Thesignatures are read out as electrical signals which are translated by acomputer into patterns recognized by classifiers as word or wordcomponents. An objective of the present system is to incorporate thesub-vocalization signatures of the user as an additional sensor inputsystem in helping determine “neural correlates of consciousness” to thesurrounding environment and as a command and control device to drive thememory enhancement portion of the present invention. Other datacollection systems that may be integrated with the present logging andmemory enhancement system and method include infrared and LIDAR systems.LIDAR (Light Detection And Ranging) is an optical remote sensingtechnology that measures properties of scattered light to find rangeand/or other information of a distant target. LIDAR systems can seethrough fog and darkness to record the shape and motion of objects intheir FOV, overcoming the limitation of visible spectrum cameras. ALIDAR systems and methods of a type that may be integrated into and iscompatible with the present invention are those found in U.S. PatentApplication 2003/0154010 and U.S. Pat. No. 6,859,705, by Rae et al,dated 14 Aug. 2003 and 22 Feb. 2005, entitled “Method for Operating apre-crash sensing system in a vehicle having a countermeasure system”using a radar and camera; U.S. Patent 2007/0001822 by Karsten Haug,dated 4 Jan. 2004, entitled “Method for improving vision in a motorvehicle”; and that mentioned in U.S. patent application Ser. No.11/432,568 entitled “Volumetric Panoramic Sensor Systems” filed May 11,2006 and LIDAR systems cited in related patent applications by thepresent inventor. An objective of the present invention is to provideand embodiment to the present invention which includes a LIDAR systemfor logging the surrounding environment. The LIDAR system may beintegrated into sensor assembly 2.

Finally, still referring to FIGS. 22 and 28, software and firmwarerunning on device 44 of a type that is incorporated into the presentinvention to filter data and make correlations between body sensors andexternal sensors signatures collected (i.e. eye-tracking sensor, voicerecognition sensor, sub-vocal recognition emanations, brain patterndata, and panoramic video, and manual touch screen device inputs) thatmay be incorporated in the present invention is the disclosed in U.S.Patent 2009/0196493, dated 6 Aug. 2009, by Widrow et al entitledCognitive Method and Auto-Associative Neural Network Based Search Enginefor Computer and Network Located Images and Photographs. Hierarchicaltree and relational databases familiar to those in the computer industryand artificial intelligence discipline are incorporated in the presentinvention to organize and retrieve information in computer 44. Widrowteaches storing input data, images, or patterns, and quickly retrievingthem as part of a computer system when cognitive memory is prompted by aquery pattern that is related to the sought stored pattern. Widrowteaches search, filtering techniques, pre-processing of sensor data,post processing of sensor data, comparator operations done on data,storage of data, and keying techniques incorporated into the presentinvention. Widrow also teaches that the computer may be part of acomputer or information appliance and that the system may be remotelyconnected to the global information grid (GIG)/internet and theprocesses distributed. U.S. Patent Application 20070124292 A1, byKirshenbaum et al, dated 31 May 2007, entitled Autobiographical andOther Data Collection System teaches a stereoscopic video logging systemwith recall. However, neither Widrow nor Kirshenbaum teach the presentinvention. The correlation and filtering of multi-sensory data providedby the host of sensors systems illustrated in FIGS. 22 and 28 areoperated upon in the present invention by device 44 to command apparatus1, the sensor systems themselves, and audio-visual presentationsinteractively provided to the user 22.

FIG. 28b is an exterior view of the user depicted in FIG. 28a wearing askull cap with neural sensing capabilities that provide fMRI readingsthat assist the device 44 in interactively operating and driving thearmature and spherical sensor worn by the user for face-to-facepanoramic video teleconferencing. A wig 95, also referred to by some asa hairpiece, which is woven into the outer side of the skull cap 89. Thehair fibers and flesh colored skull cap is used to hide or conceal brainactivity components of the present invention that are mounted in and onthe head of the user according to the present invention. The brainactivity scanning components are located between the material holdingthe hair and the material next to the head of the user that makes up thehair-piece. Besides brain activity sensors, other sensors and electricalcomponents may be situated in the skull cap in accordance consistentwith the present invention. Examples of portable neural sensing systemsthat may be used with the present invention include includes MagneticResonance Imaging devices such as the Atomic Magnetometer Sensor ArrayMagnetic Resonance (AMR) Imaging Systems and Methods. Recently portableAtomic MR systems such as those described in U.S. Patent 2009/0149736,dated 11 Jun. 2009 by Skidmore et al and U.S. Patent 2010/0090697, dated15 Apr. 2010 by Savukov have been disclosed that are of a typecompatible and enabling of the present invention. John Kitching, aphysicist at the National Institute of Standards and Technology inBoulder, Colo. has developed a tiny (grain of rice size) atomic magneticsensors of a type compatible for use in the present invention.Specifically, systems and devices disclosed in the Skidmore patent andKitching presents a wearable portable array, of reduced size, low powerconsumption, reducible to a wafer-level, has rapid signal transfer, andwith decreased magnetic field that facilitates lower cost and easymounting on and/or inside a person, animal, or inanimate object. U.S.Patent Application 20100016752, by Jeffery M. Sieracki dated 21 Jan.2010 entitled System and Method for Neurological Activity SignatureDetermination, Discrimination, and Detection discloses a system forautomatically correlating neurological activity to a predeterminedphysiological response comprising: at least one sensor operable to sensesignals indicative of the neurological activity; a processing enginecoupled to said sensor, said processing engine being operable in a firstsystem mode to execute a simultaneous sparse approximation jointly upona group of signals sensed by said sensor to generate signatureinformation corresponding to the predetermined physiological response;and, a detector coupled to said sensors, said detector being operable ina second system mode to monitor the sensed signals and generate uponselective detection according to said signature information a controlsignal for actuating a control action according to the predeterminedphysiological response.

FIG. 29a is a diagrammatic perspective illustrating another embodimentof the support device apparatus 1 in communicating relationship toelectronic device 44. This embodiment comprises a electronic deviceadapter system 96 for capture, transmission, and focusing a displayedimage onto the image sensor 97 of the electronic device 44, like an IPhone.

FIG. 29b is a plan sectional view of the sensor assembly 2 depicted inFIG. 29a that records audio and image signatures of the surroundingenvironment. Two objective lens systems OL1 and OL2 transmit imagesthrough objective lens 24 a and 24 b to relay optic 100 a and 100 b thattransmit the images off axis through focusing lenses 101 a and 101 b toan HD image sensor 26. The relay optics may be mirrors, prisms, or fiberoptic image conduits. Optionally a non-uniform fiber optic image bundleknown as “Fibreye”, or a panamorphic lens arrangement, may be positionedin the optical path either in the sensor assembly 2 or adapter 96 toreduce barrel distortion introduced by the fisheye lenses 24 a and 24 b.The image sensor 26 may comprise a VLSIC that incorporates ROIprocessing. Referring to FIG. 24a , in such an instance the sensor mayread out the entire HD image 83 or a portion of the image 88 forprocessing additional processing or display. The VLSIC may also includepanoramic image processing and other image processing applications codedinto the VLSIC firmware, such as distortion removal, image stitching,orientation correction, scaling, feature tracking, and vibrationcorrection. For example, referring to FIG. 24b , if distortion isremoved the image 85 or 88′ may be read out. Preferably, the VLSIC is aFPGA type that may is dynamically programmable such that it responds tocommands interactively commanded issued in real time by the useroperating device 44. The image from the sensor is read out to a highintensity display 102. The image displayed on the display side of thehigh intensity display 102 is oriented such that the displayed image isthen imaged through focusing lens optics 103 to the entrance end 104 ofa fiber optic imaging bundle 105. The focused image is then transmittedthrough the fiber optic imaging bundle 105 to the exit end 106 ofbundle.

FIG. 29c is a side sectional drawing of the electronic device shown inFIG. 29a with an attached electro-optical adapter system for capture,transmission, and focusing a displayed image onto the image sensor ofthe electronic device 44, like an IPhone 4S or iPhone 5. As depicted inFIG. 29b this is accomplished by sensor 2 capturing the image and thentransmitting the image to a display for projection onto the image sensorof the device 44. And adapter assembly housing holds the display andrelay lens assembly in communicating relationship to focus the displayedimage onto the sensor of the electronic device 44. The focused image atthe exit end 106 of the bundle 105 is then transmitted through relayoptics 107 and adaptor lens optics 108 through the camera optics 109 infocus to the image sensor 97 of device 44. A high intensity display 102of a type compatible with the present invention is typically used invideo projection systems. A very bright HDTV display system compatiblewith and integrated by reference into the present invention manufacturedby Microvision of Redmond, Wash., includes the small portable IntegratedPhotonics Module (IPM) only a couple of centimeters square or a DSLPdisplay manufactured by Texas Instruments for use in HD videoprojections systems. A high intensity display chip is preferred in orderto compensate for the loss of light intensity when the image istransmitted through the clad fiber optic imaging bundle 105.

Referring again to FIG. 29b , miniature microphones 25 a to the ninthrecord audio signatures and transmit them through wiring 98 that runsthrough cable 8 that transverses support armature 3. The microphones areconnected by circuitry located in the sensor assembly support housing 99that is supported by armature 3. All components that comprise the sensorassembly 2 are held in place by support housing 99. The housing is maybe constructed of hard plastic, metal, or any suitable material.Electronic devices that comprise the sensor assembly 2 are poweredelectrically from power transmitted through cable 110 and circuitryoriginating in device 44. Cable 110 functions to not only carryelectrical power to devices in the sensor assembly 2, but to also powerother devices that are part of the support assembly, like servo S1 andS2, the display integrated into the senor head, or other electronicdevices worn by the user. Battery packs and other peripheral devices maybe attached to device 44 through the connector 93 in order to enhancethe operation and functionality of the support device apparatus 1.

FIGS. 29a and 29b also illustrate an additional embodiment of thesupport assembly in which a rectangular LED or OLED display 112 isplaced on the armature for near field of view display. Optionally, nearfield of view optics are placed between the eyes of the user and thedisplay to enlarge and focus the image displayed. In operation the userlooks over the armature, sensor, and display to view subjects in the midand far foreground, and may glances down to view the display 112 mountedon the sensor assembly 2. Focusing on the armature display by the useris accommodated by the user wearing his or her close field-of-viewcontact lens in the eye on the side the display is located. Stillalternatively, focusing on the armature display may be accommodated bythe user looking through the bottom portion of his or her eyeglasseswhich are typically for near field of view if the glasses are of abi-focal or progressive lens design. In the optical arrangement shown inFIG. 29a the display is hidden from the FOV coverage of the back-to-backfisheye lenses. This is because the display is within the parallax areawhere the two fisheye lenses have adjacent field of view coverage 111.This design allows the display not to interfere with the panoramic imagecaptured. Optionally, the LED or OLED display 112 are constructed withsee-through display material. The see-through display may be eitherattached on the sensor assembly 2 or armature 3. The display is attachedsuch that it may be looked thorough by the user such that graphics andimages may be overlaid over the real world scenery on the other side ofthe display 112.

FIG. 29d describes a final embodiment of the adapter assembly 96. Inthis alternate adapter assembly design 96′ the image signal from sensor102 is transmitted over wire 116 through cable 8″ to HD display 115. Theimage on display 115 is then optically transmitted through adapter lensassembly 108 through the camera lens 109 to the image sensor 97 in focusof the portable wireless device 44. Optionally a non-uniform fiber opticimage bundle known as “Fibreye” 113 arrangement, may be positioned inthe optical path of the adapter 96′ to reduce barrel distortionintroduced by the fisheye lenses 24 a and 24 b. Electrical power issupplied to the display 115 and other devices that require electricalcurrent to operate via cable 110 that connects to device 44. Optionally,a battery is integrated into the support assembly to provide electricalpower to devices that comprise support assembly apparatus 1.

FIG. 30a-d are exterior perspective diagrams that illustrate severalnovel embodiments of the panoramic support that form support deviceapparatus 1. FIG. 30a illustrates an embodiment in which the inventionis integrated into an electronic communication device entirely worn onthe user's head 22. In this arrangement all components of device 44 areintegrated into the head worn support structure in a standalone manner.

FIG. 30b is an exterior perspective where a cap includes the headmounted components 44 comprising the present invention. Objective lensesare mounted on the vamp of the cap to capture the users face whilesimultaneously while other objective lenses face outward to captureimagery of the surrounding environment. Sensor assembly 2 may be mountedon armatures that swing down from the vamp of the cap to capture theusers face and foreground, or over the top of the cap to capture theforeground and background. A plurality of armatures 2 a and 2 b may beused in order to capture stereoscopic imagery of the users face andsurrounding environment. Alternatively or additionally, objective lensesmay be mounted in the brim of the cap to capture imagery of thesurrounding environment. In this arrangement portable communication,camera, audio, and AMR or fMRI and processing system are integrated intothe outer material of the crown, vamp, brim, and ear flap of the cap.The cameras and microphones mounted on the cap may be very small suchthat the cap appears to be of a conventional nature, thus not drawinginordinate attention and being accepted by the wearer and person's inthe surrounding environment. Cameras associated with the objectivelenses visible on the outside of the cap are supported and concealed inthe interior body of the cap. An eye tracking 12 camera or cameras arelocated in the bill or brim of the cap. The neural/brain activity sensorsystems sensors extend around the head such that they surround the brainas previously described in FIGS. 28a and 28b . The flap of the cap mayinclude an opening for the ear. Optionally, the head worn device alsoincludes an eye-tracking 12, head position sensor, optional targetdesignator, throat microphone, sub-vocalization sensor sensors, andoptional in hat electronics such as processing systems, head worncontrol electronics and adjustment features as described in FIGS. 20-22.A cable located at the back of the cap connects to device 44 or aportable computer located in the users backpack. The cable may be usedto provide electrical power and input/output data to and from the hostcomputer and head worn device that includes the nerual/brain activitysensors, camera sensors, and head mounted display device.

FIG. 30c illustrates an embodiment of the invention in which the sensorassembly 2 flips up from the belt of a user 22. The integratedaudio-visual sensor capture device simultaneously records a contiguoussurrounding spherical scene. The sensor capture device 2 is on anarmature 3 that flips up from a housing attachable to the belt buckle ofthe user. Located within the housing is an electronics assembly 44 fordriving the audio-visual capture device, telecommunication electronics,and battery storage means to power the electrical components of thehead-worn system 7, 12, and 34. The electronics assembly 44 connects toand is in communication with a head mounted display device 7. The devicemay communicate by a wire 8, fiber optic, or wireless connection 76. Theelectronics assembly 44 includes firmware or software for tracking thehead and hand position of the user 22. The support arrangement may beused to illustrate an interactive gaming application. Data from thesensor is operated upon to drive an interactive computer game that isdisplayed on the users head mounted display device 7. The imagegenerated for display is affected by the users head position. Forinstance, if the users head is turned to the left, the users displayresponds by panning the scene to the left as the user moves his head.Hand movement is also tracked to affect the game. For instance, if theuser moves his trigger finger a simulated gun is fired in the game. Theuser may also use the device for telecommunication. Hand gestures may beused to control the device. Connectivity between the electronicsassembly and the head-mounted display device may be by wire 8,fiber-optic conduit, or wireless means 76. For instance, wirelessconnectivity and communication may be by traditional cellular telephoneand Bluetooth connectivity.

FIG. 30d illustrates an embodiment of the invention in which the sensor2 is unplugged from an armature or charging assembly as described inFIGS. 10a, 10b, and 10c and used remotely. The sensor 2 capture devicethat simultaneously records a contiguous surrounding spherical scene.The sensor capture device 2 is enclosed in a user positional sphericalhousing. Located within the housing is an electronics device 44 fordriving the audio-visual capture device 2, telecommunicationelectronics, such as a radio frequency data link 12, to the wireless onbody servo mechanisms, sensors, and displays which may have a built intransceiver for wireless communication with between components. Batterystorage is integrated into the invention individually or collectivelyprovide power to the devices electrical components. The device isdesigned to communicate using traditional wireless connectivity 76, suchas cellular telephone and Bluetooth connectivity. The device maycommunicate with the in eye, on eye, or head mounted display 34. Inoperation the user positions the sensor assembly 2 in a nearby locationand commands the electronics assembly 44 to receive and transmitaudio-visual information derived from the sensor assembly.

Additional applications envisioned by the present inventor and withinthe scope of the present invention include using the support assemblydata logging life experiences of a user or another person the user isassociated with; reality movie and television production; security;marketing, education; and health care. Specifically, facial analysisapplication firmware and hardware that read a user or bystander's mood,interests, and vital signs may be integrated into the invention. In suchan embodiment facial data gathered by sensor assembly 2 is transmittedto mobile device 44. Device 44 would perform standalone analysis on theinformation or transmit the information to a remote location foranalysis, additional processing, or storage. The information yielded bythe analysis is then acted upon or logged for future reference. Finally,the present invention will enable on-the-move panoramic hands-freeface-to-face interaction between people and machines allowing people toperform tasks that cannot be performed currently required to hold amobile device in ones hand while communicating on the move. For example,simultaneously recording a person's face and body who is riding abicycle and observing what they are responding to in the surroundingenvironment. Or simultaneously having a face-to-face telepresenceconversation with a person in order to assist him while his or her handsperform an emergency medical procedure, like CPR.

Those skilled in the art will know, or be able to ascertain using nomore than routine experimentation, many equivalents to the specificembodiments of the invention described herein. These and all otherequivalents are intended to be encompassed by the following claims.

Having thus described various embodiments of the invention, what isclaimed as new and desired to be protected by Letters Patent include thefollowing:

1. A compensation system for a facial sensor that blocks thefield-of-view of the user comprising: a physiological sensing subsystem;a surrounding environment sensing subsystem; an automated sensor supportsubsystem; a command and control subsystem; said subsystems beingconfigured as a user portable system with at least one a user mountedhousing, electrical power source, and circuitry to communicativelyconnect said command and control subsystem with said sensing subsystemsand said automated sensor support subsystem; said command and controlsubsystem driving said sensing subsystems and said automated supportsubsystem based on user commands and signatures derived from saidsensing subsystems; said automated sensor support subsystem driving atleast one armature connected to at least one sensor of said sensingsubsystems to a position outside the fine focus field-of view of theuser or to an alternate position.
 2. The system according to claim 1,wherein: said sensor support subsystem comprises an actuator attached toan adjustable armature to automatically position a surroundingenvironment sensing subsystem comprising a spherical field-of-viewsensor assembly to a predetermined position forward of the face of auser or predefined alternate position; said actuator responsive tocommand and control signals from a command and control subsystemcomprising a host personal electronic device (PED), like a iPhone, thatmoves said sensor with spherical field-of-view FOV coverage forward ofthe users face at the initiation of a panoramic video telephoneconversation; said sensor assembly including an image capture capabilityto record a scene for display; said actuator further responsive to thecommand and control signals derived by physiological sensing subsystemcomprising an eye-tracking system and host PED which operates inconjunction on imagery captured by the sensor to move the sensorassembly and armature outside of the fine focus FOV of the user so notto block the fine focus FOV of the user but still leave the sensorwithin monitoring relationship to at least one of the eyes of the userbeing tracked; and sensor electronics of at least one of said subsystemsincluding image processing hardware and firmware that are simultaneouslyresponsive to read out imagery for transmission and display of the usersregion-of-interest derived from the eye-tracking system and sensorassembly operating in conjunction with the PED, the face of the wearercaptured by the sensor assembly, allow panning and zooming around thepanoramic scene, and windowing or overlaying of imagery, graphics, ortext or any combination thereof by the user or a person at a remotelocation involved in the panoramic video telephone conversation.
 3. Thesystem according to claim 1, wherein: said sensor support subsystemcomprises at least one automated servo for at least one extending,retracting, positioning, or rotating at least one armature or sensorinto a position about the body of the user to facilitate capture of atleast one signature from the sensing subsystems worn by the user; saidsubsystems being configured as a user portable system with at least oneuser mounted housing, electrical power source, and circuitry tocommunicatively connect said command and control subsystem with saidsensing subsystems and said automated sensor support subsystem; saidcommand and control subsystem driving said sensing subsystems and saidautomated sensor support subsystem based on user commands and signaturesderived from said sensing subsystems to automatically move at least onesaid sensor subsystem in a hands-free manner about the body of saiduser.
 4. The system according to claim 1, wherein: said automated sensorsupport subsystem with an armature and sensor with a manual overridethat allows the user to at least one turn off or not use the automatedfeature of said mechanism of said support subsystem and manuallyposition at least one the extending, retracting, positioning, orrotating of the armature and sensor about the body of the user tofacilitate capture of a signature by the sensing subsystems worn by theuser.
 5. The system according to claim 1, wherein: said physiologicaland surrounding environmental sensing subsystems comprise at least oneon the following sensing subsystems; a panoramic camera subsystem withat least one monocular, binocular, or stereoscopic image recording,playback, live, and live streaming capability; said camera having atleast one a still and motion imaging capability; a Light Detection AndRanging (LIDAR) subsystem to at least one find range and/or otherinformation of a distant target, record shape and motion of objects inthe field-of-view of said system; at least one tracking subsystem toinclude at least one eye (i.e. via optical and electrooculography eyetracking), target, gesture, region-of-interest, or feature tracking andoptionally an identification subsystem; a brain activity sensingsubsystem (i.e. EEG, MRI, and EMG Electromyography electrical potentialneurological activated, etc.) wherein said command and control subsystemoperating on brain activity signatures derived from said physiologicalsensing subsystem consisting of said brain activity sensing subsystem; aspeech recognition subsystem; said speech recognition subsystemreceiving voice commands; said speech recognition including a computersystem that identifies words and phrases in spoken language and convertsthem to machine language; a sub-vocalization recognition (SVR) subsystemwherein signatures from electrodes placed on the users throat produceelectromyograms are pattern-matched to known words the user is saying;said words being recognized by a computer without the user opening hisor her mouth and uttering a sound; an audio subsystem with at least onea mono, stereo, or directional sound recording for processing andplayback by an audio subsystem; said physiological and surroundingenvironmental sensing subsystems providing information to system to atleast one position said sensor support armature out of the fine focusfield-of-view of said user, to position other subsystem sensors forimproved signature reception, to position peripheral devices like anarmature mounted display in an improved position, to position saidsensor support armature in an alternate position, to capture informationfor further processing, and to capture information for display for atleast one the wearer of said system and a user at a remote location. 6.The system according to claim 1, wherein: said sensing subsystems andcommand and control subsystem comprises at least the functionality of aportable personal electronic device (PED) (i.e. an iPhone)simultaneously responsive to read out imagery for at least onetransmission or display of a region of interest of the user derived byat least one a tracking system and a spherical FOV camera system as theeye-tracking system tracks the at least one eye of said user, wherein atleast one of said PED further comprising processing means for panningand zooming around the foreground scene, displaying a graphical userinterface window via the display device, or overlaying secondary imageryover the modified imagery via the display device.
 7. The systemaccording to claim 1, wherein: said command and control system includesa personal electronic device (PED) that includes a computer processingsystem with firmware that operates to filter and correlate data frommultiple sensor assemblies of at least one a physiological orsurrounding environment sensing subsystem that includes at least one apanoramic camera, voice recognition, or brain activity sensor systemthat drives said automated sensor support subsystem that includes anarmature and sensor with at least one actuator to position at least onesaid sensor to a recording or alternate position.
 8. The systemaccording to claim 1, wherein: said subsystem and components of saidsystem are reconfigured into separate housings that are wirelesslyconnected and continue to function as said system, each saidreconfigurable housed subsystem and component including electroniccircuitry with a transceiver for interconnecting separated saidsubsystems and components and including an electric power unit in theform of a battery to power each said subsystem and components beingmounted on or adjacent to a local user or a remote user.
 9. The systemaccording to claim 1, wherein: a sensor, armature, support housing, orcombination thereof in which at least one of the automated sensorsupport system includes a transceiver and battery unit that unplugs fromthe armature and is positioned in a remote location for wirelesscommunication with at least one a PED, EMD, HMD, display integrated intoa armature, mast, camera, integrated camera display or a combinationthereof of said system.
 10. The user portable system according to claim1, wherein: said surrounding environmental sensing subsystem comprises apanoramic camera system with at least one integrated electronic displaydevice; said display device integrated into at least one a sensor,sensor housing, or the support armature or mast supporting the sensor;said display oriented in an outward facing manner from said supportstructure for view by said local or remote user.
 11. The wearablearmature for attaching a personal electronic device and portablespherical field-of-view camera to the head of a user according to claim1, comprising: a spherical field-of-view sensor assembly including asensor housing, said camera system with a plurality of objective lensesfacing outward to provide continuous spherical field-of-view coveragemounted within the sensor housing; said camera having standalonecapability except for a display device; said camera having at least onea land line and wireless still image and video output capability forconnecting to at least one a personal electronic device (PED); saidcamera system mounted within the sensor housing in visual line of siteto the face and at least one eye of the user; a support housing beingadjustably mounted to a support armature while the support housing issecured by a fastener relative to the head of the user; said camerasensor housing connected by a fastener that attaches to the distal endof the support armature; support housing including fasteners to securethe housing to the users head such that the housing, support armature,and sensor assembly are positioned by the user to be in front of theusers face but not blocking the fine focus field-of-view of the user; atleast one of said armature and sensor assembly including fasteners forconnecting said PED and portable spherical field-of-view camera to thehead of said user; said PED being portable and able to operate in astandalone manner; said PED including circuitry provided output incommunicating relationship to receive from said camera via a flexiblecable and connector so that imagery is transmitted from said camerathrough said cable and connector; said PED including a integrateddisplay with a touch-screen at least one mounted on the armature or thesensor assembly forward and in communicating relationship to at leastone of the eyes of the user; images derived from the sensor assembly arepresented on the display of a PED fastened to the armature or sensorhousing allowing the user to view with near field-of-view optics mountedbetween users eyes and the display.
 12. The wearable armature forattaching a PED and portable spherical field-of-view camera to the headof a user according to claim 1, comprising: a spherical field-of-viewsensor assembly including a sensor housing, said camera system with aplurality of objective lenses facing outward to provide continuousspherical field-of-view coverage mounted within the sensor housing; saidcamera having standalone capability except for a display device; saidcamera having at least one a land line and wireless still image andvideo output capability for connecting to at least one a personalelectronic device (PED); said camera system mounted within the sensorhousing in visual line of site to the face and at least one eye of theuser; a support housing being adjustably mounted to a support armaturewhile the support housing is secured by a fastener relative to the headof the user; said camera sensor housing connected by a fastener thatattaches to the distal end of the support armature; support housingincluding fasteners to secure the housing to the users head such thatthe housing, support armature, and sensor assembly are positioned by theuser to be in front of the users face but not blocking the fine focusfield-of-view of the user; at least one of said armature and sensorassembly including fasteners for connecting said PED and portablespherical field-of-view camera to the head of said user; said PED beingportable and able to operate in a standalone manner; said PED having awireless communicating relationship with said camera for receivingpanoramic imagery and command and control operations; said PED includinga integrated display with a touch-screen at least one mounted on thearmature or the sensor assembly forward and in communicatingrelationship to at least one of the eyes of the user; images derivedfrom the sensor assembly are presented on the display of a PED fastenedto the armature or sensor housing allowing the user to view withnear-field of view optics mounted between users eyes and the display.13. The wearable armature for attaching to a portable sphericalfield-of-view camera to the head of a user according to claim 1,comprising: a spherical field-of-view sensor assembly including a sensorhousing, said camera system with a plurality of objective lenses facingoutward to provide continuous spherical field-of-view coverage mountedwithin the sensor housing; said camera having standalone capabilityexcept for a display device; said camera having at least one a wirelessstill image and video output capability for connecting to at least one aLED/OLED display device; said camera system mounted within the sensorhousing in visual line of site to the face and at least one eye of theuser; a support housing being adjustably mounted to a support armaturewhile the support housing is secured by a fastener relative to the headof the user; said camera sensor housing connected by a fastener thatattaches to the distal end of the support armature; support housingincluding fasteners to secure the housing to the users head such thatthe sensor assembly with LED/OLED display device is positioned by theuser to be in front of the users face but not blocking the fine focusfield-of-view of the user; at least one of said armature and sensorassembly including fasteners for connecting said LED/OLED displaydevice; said LED/OLED display device being portable and able to operatein a standalone manner; said PED including circuitry to at least onecommunicate via wire or wirelessly via a transceiver with said LED/OLEDdisplay device; said PED including a integrated display with atouch-screen at least one mounted on the armature or the sensor assemblyforward and in communicating relationship to at least one of the eyes ofthe user; images derived from the sensor assembly are presented on thedisplay of a LED/OLED display device fastened to the armature or sensorhousing allowing the user to view with near-field of view optics mountedbetween users eyes and the display.
 14. The wearable armature forattaching a personal electronic device and portable sphericalfield-of-view camera to the head of a user according to claim 1,including: an integrated camera and display comprising an LED/OLED arraylens-less camera with touch-screen and user interface devices andassociated processors; said integrated camera and display incorporatedfor multiple uses in the present invention to include at least one as aspherical field-of-view camera, a camera for eye tracking, a display,and touch-screen embodiment, said embodiments including at least one anintegrated eye-tracking camera and a head-mounted display screen; or adisplay and touch-screen for a spherical FOV camera housing, armature,and sensor assembly.
 15. The system according to claim 1, furtherincluding; an image stabilization at least in one a spherical viewcamera comprising the a physiological sensing subsystem and asurrounding environment sensing subsystem and a automated sensor supportsubsystem.
 16. The wearable system for attaching a portable sphericalfield-of-view camera and display to the head of a user according toclaim 1, comprising: a spherical field-of-view sensor assemblyincluding: a sensor housing; said camera system with a plurality ofobjective lenses facing outward to provide continuous sphericalfield-of-view coverage mounted within the sensor housing; said camerahaving standalone capability except for a display device; said camerahaving at least one video output capability via transceiver and outputjack (i.e. HDMI); a support housing being adjustably mounted to thesupport armature while the support housing is secured by a fastenerrelative to the head of the user; said camera sensor housing connectedby a fastener that attaches to the distal end of the support armature;said camera system mounted within the sensor housing in visual line ofsite to the face and at least one eye of the user; circuitry included insaid housing miming through the support armature through at least onemale and one female connecting jack between the armature and the camera;said circuitry facilitating command and control, physiological sensingsubsystem, surrounding environment sensing subsystem, a display device,other peripheral device in communication with said apparatus,transmission of electrical power to the camera, or alternatively toprovide just structural support and positioning of the sensor assemblyif the attached sensor assembly has a wireless standalone capability;circuitry provided to connect in communicating relationship said camerathrough said support armature to a armature mounted camera forconnection to a portable digital device via a flexible cable andconnector; at least one actuator attached to said support armature thatat least one raises, lowers, extends, rotates, or retracts at least onethe armature and sensor assembly to a predetermined positon forward ofthe face of the a wearer or alternate position; said actuator responsiveto command and control signals from said portable digital device andsaid sensor assembly such a that the sensor is moved forward of theusers face at the initiation of a hands-free panoramic videoteleconference conversation; an integrated display with touch-screen andassociated processors at least one mounted below the armature or thesensor assembly, images derived from the sensor assembly are presentedon the display of a personal electronic device (PED) mounted fastened tothe armature or sensor allowing the user to view with near field of viewoptics mounted between users eyes and the display, wherein at least oneactuator attached to the adjustable armature positions the sensorassembly with derived from an eye tracking system to move the sensorassembly and armature outside of the mid and distant range fine focusfield-of-view of the wearer so not to block the fine focus field-of-viewof the wearers field-of-view of the foreground, but still position thedisplay just below the find focus field-of-view and within readingdistance of the users close in field-of-view such that the user looksover the armature and sensor assembly to view the foreground, glancesdown to read the display on the armature, and positions the armatureselectively to look through the display for augmented realityapplications, support housing including fasteners to secure the housingto the users head such that the housing, support armature, and sensorassembly are positioned by the user to be in front of the users face butnot blocking the fine focus field-of-view of the user.
 17. A userportable system according to claim 1, further comprising: an OLEDdisplay is mounted below an armature or the sensor assembly, imagesderived from the sensor assembly and from the personal digital assistantare presented to the user for viewing with near field of view opticsmounted between users eyes and the display, wherein at least oneactuator attached to the adjustable armature positions the sensorassembly derived from an eye tracking system to move the sensor assemblyand armature outside of the mid and distant range fine focusfield-of-view of the wearer so not to block the fine focus field-of-viewof the wearers field-of-view of the foreground, but still position thedisplay just below the find focus field-of-view and within readingdistance of the users close in field-of-view such that the user looksover the armature and sensor assembly to view the foreground, glancesdown to read the display on the armature, and positions the armatureselectively to look through the display for augmented realityapplications.
 18. A user portable system according to claim 1, furthercomprising: said automated sensor support subsystem including a gimbalmechanism that rotates the optical axis of at closest one of theobjective lenses of a spherical FOV camera in an orientation of the sameoptical axis as the objective lens to of at least one the ConsciousPrecept (CP) or the Region of Interest (ROI) defined by at least one theuser, a remote user, or said system defined orientation or subject; saidrotation compensating for having a seam in the middle of said ROI or CPthe user or the sensing system is focused upon and in order to makeimage processing for said system less difficult and achieve imagecontinuity.
 19. A system according to claim 1, further comprising: auser unique relational database generated by said mobile system goingabout life outside a laboratory environment; said database including atleast one a surrounding environment information logged by saidsurrounding environmental sensing subsystem, a physiological informationlogged by said physiological sensing subsystem, and a correlatedrelational database generated by said command and control subsystem thatfunctions as the central processing unit for said system for use inmechanical, biological, or bio-mechanical system; said databaseproviding a correlated historical accessible database for positioningsaid armature with sensor.
 20. A display system for a portable sphericalcamera system for a comprising: a portable spherical field-of-viewcamera including a compensation system for a facial sensor that blocksthe field-of-view; said compensation system comprising a support housingincluding fasteners to secure the housing to the users head such thatthe housing, support armature, and a spherical field-of-view sensorassembly positioned by the user to be in front of the users face but notblocking the fine focus field-of-view of the user; said camera systemand said user portable display system including at least one operatingsystem software or firmware application to cooperatively process saidspherical camera imagery and electrical power source to process saidpanoramic image for further processing or viewing while not blocking thesensors view of the users face or the users view of imagery and overlaidgraphics and text on a display presented to a local or remote user; saidcamera including a communication device to transmit camera imagery bythe use of circuitry or wirelessly at least some portion of said derivedimage from said camera system to at least one a personal electronicdevice (PED) display, eye mounted device (EMD) display, head mounteddisplay (HMD) device, spherical camera housing display, integratedLED/OLED camera/display with touch-screen and associated processors,camera armature integrated display, or camera mast integrated display.21. A wearable apparatus for attaching a portable sphericalfield-of-view camera to the head of a user comprising: a sphericalfield-of-view sensor assembly including: a sensor housing, a camerasystem with a plurality of objective lenses facing outward to providecontinuous spherical field-of-view coverage mounted within the sensorhousing; a support housing being adjustably mounted to the supportarmature while the support housing is secured by a fastener relative tothe head of the user; said camera sensor housing connected by a fastenerthat attaches to the distal end of the support armature; said camerasystem mounted within the sensor housing in visual line of site to theface and at least one eye of the user; circuitry included in saidhousing miming through the support armature through at least one maleand one female connecting jack between the armature and the camera; saidcircuitry facilitating command and control, physiological sensing, adisplay device, other peripheral device in communication with saidapparatus, transmission of electrical power to the camera, oralternatively to provide just structural support and positioning of thesensor assembly if the attached sensor assembly has a wirelessstandalone capability; circuitry provided to connect in communicatingrelationship said camera through said support armature to a armaturemounted camera for connection to a portable digital device via aflexible cable and connector; at least one actuator attached to saidsupport armature that at least one raises, lowers, extends, rotates, orretracts at least one the armature and sensor assembly to apredetermined positon forward of the face of the a wearer or alternateposition; said actuator responsive to command and control signals fromsaid portable digital device and said sensor assembly such a that thesensor is moved forward of the users face at the initiation of ahands-free panoramic video teleconference conversation; and supporthousing including fasteners to secure the housing to the users head suchthat the housing, s support armature, and sensor assembly are positionedby the user to be in front of the users face but not blocking the finefocus field-of-view of the user.